00000001:02000400:3.0F:1788390242.702519:0:3298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788390251.360023:0:3500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788390252.325305:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1147 MB/s 00000001:01000000:2.0:1788390252.575581:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1755 MB/s 00000001:01000000:2.0:1788390252.825380:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10519 MB/s 00000020:02000000:1.0F:1788390253.136592:0:3591:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g4d1530a 00000400:02000000:3.0:1788390253.558115:0:3606:0:(api-ni.c:2824:lnet_startup_lndni()) Added LNI 192.168.202.111@tcp [8/256/0/180] 00008000:02000000:3.0:1788390256.046092:0:3756:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788390282.194244:0:5720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788390289.462061:0:6469:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788390289.462068:0:6469:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788390289.462069:0:6469:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788390289.462196:0:6469:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000cd39c42f 00000080:02000400:0.0:1788390289.462205:0:6469:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788390289.468364:0:6469:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788390289.468378:0:6469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788390289.468410:0:6469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009994849e) 00000020:00000080:0.0:1788390289.468436:0:6469:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788390289.500814:0:6469:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788390289.500871:0:6469:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788390289.512668:0:6469:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788390289.512911:0:6469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788390289.512920:0:6469:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788390289.512931:0:6469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be970b9 00000020:01000004:0.0:1788390289.512937:0:6469:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788390289.512943:0:6469:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788390289.512948:0:6469:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cd39c42f from MGS 00000020:01000004:0.0:1788390289.512952:0:6469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788390289.512962:0:6469:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008e541a1e) 00000020:00000080:0.0:1788390289.513103:0:6469:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788390289.513188:0:6469:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cd39c42f from MGS, refs=2 00080000:01000000:0.0:1788390289.513196:0:6469:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788390289.513202:0:6469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be970c7 00000100:00100000:2.0:1788390289.513592:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788390289.513723:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788390289.513730:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788390289.514037:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788390289.514044:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788390289.515660:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390289.515777:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788390289.515782:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788390289.516233:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788390289.516239:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788390289.516437:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788390289.516444:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788390289.516829:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390289.516833:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390289.516834:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390289.516972:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390289.516974:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390289.516980:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390289.517244:0:6469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788390289.522533:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788390289.766591:0:6469:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5639 MB/s 00000001:01000000:0.0:1788390290.016495:0:6469:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6879 MB/s 00000001:01000000:0.0:1788390290.266445:0:6469:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 895 MB/s 00000001:01000000:2.0:1788390290.516749:0:6469:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1611 MB/s 00080000:10000000:2.0:1788390290.519588:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788390290.525870:0:6469:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788390290.526505:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788390290.526547:0:6469:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788390290.526586:0:6469:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788390290.526694:0:6469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788390290.526709:0:6469:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788390290.526995:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390290.527098:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788390290.527102:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788390290.530855:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788390290.530870:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788390290.531204:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788390290.531210:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788390290.533959:0:6469:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788390290.533984:0:6469:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.111@tcp' 00000020:01000004:0.0:1788390290.533986:0:6469:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788390290.534027:0:6469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.111@tcp (typ=mgc) 00000020:00000080:0.0:1788390290.534038:0:6469:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.111@tcp (0000000049b97b04) 00000020:00000080:0.0:1788390290.534053:0:6469:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788390290.534133:0:6469:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dfb0d3e0@MGC192.168.202.111@tcp: add connection 192.168.202.111@tcp at head 00010000:00010000:0.0:1788390290.534246:0:6469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.111@tcp-0 is initialized 00000040:01000000:0.0:1788390290.534251:0:6469:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788390290.534584:0:6488:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788390290.536566:0:6489:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788390290.536629:0:6469:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.111@tcp (uuid 13bece9d-37f8-46e7-9f27-a320529bc20d) 00000020:00000080:1.0:1788390290.536654:0:6469:0:(genops.c:1385:class_connect()) connect: client 13bece9d-37f8-46e7-9f27-a320529bc20d, cookie 0xe156d0713be970d5 00000100:00080000:1.0:1788390290.536669:0:6469:0:(import.c:510:import_select_connection()) MGC192.168.202.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390290.536675:0:6469:0:(import.c:624:import_select_connection()) MGC192.168.202.111@tcp: import 00000000dfb0d3e0 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390290.536727:0:6469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004b093725 x1875263097929856/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390290.536750:0:6469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS 00000020:01000004:1.0:1788390290.536774:0:6469:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788390290.536781:0:6469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788390290.536804:0:6469:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f263ac21) 00000020:00000080:1.0:1788390290.536818:0:6469:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788390290.537180:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b093725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13bece9d-37f8-46e7-9f27-a320529bc20d:3621:1875263097929856:0@lo:250: 00000100:00100000:3.0:1788390290.537289:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390290.537395:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097929856 00000100:00100000:3.0:1788390290.537403:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097929856 00000100:00100000:3.0:1788390290.537435:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390290.537441:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be1c0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3621:x1875263097929856:12345-0@lo:250: 00010000:00080000:3.0:1788390290.537504:0:6484:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 13bece9d-37f8-46e7-9f27-a320529bc20d@0@lo t0 exp 0000000000000000 cur 111 last 0 00000020:00000080:3.0:1788390290.537531:0:6484:0:(genops.c:1385:class_connect()) connect: client 13bece9d-37f8-46e7-9f27-a320529bc20d, cookie 0xe156d0713be970e3 00000100:00080000:3.0:1788390290.537671:0:6484:0:(import.c:65:import_set_state_nolock()) 00000000d99b92f6 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390290.537722:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be1c0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+5:3621:x1875263097929856:12345-0@lo:250: Request processed in 280us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390290.537729:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390290.537786:0:3621:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788390290.537793:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.111@tcp: connect to target with instance 0 00000100:00080000:3.0:1788390290.537801:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788390290.537805:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788390290.537808:0:3621:0:(import.c:65:import_set_state_nolock()) 00000000dfb0d3e0 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788390290.537810:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788390290.537817:0:3621:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788390290.537822:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b093725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13bece9d-37f8-46e7-9f27-a320529bc20d:3621:1875263097929856:0@lo:250: 00000100:00100000:3.0:1788390290.545993:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390290.546194:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788390290.546200:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788390290.546867:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788390290.546873:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788390290.547118:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788390290.547125:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788390290.547666:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390290.547776:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788390290.547779:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788390290.548237:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788390290.548242:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788390290.573114:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390290.573297:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788390290.573304:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788390290.574083:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788390290.574096:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788390290.574596:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390290.574700:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788390290.574703:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788390290.575054:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788390290.575058:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788390290.575596:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390290.575690:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788390290.575692:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788390290.577043:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788390290.577050:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788390290.577755:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390290.577869:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788390290.577872:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788390290.578166:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788390290.578170:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00010000:00010000:2.0:1788390290.578422:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390290.593623:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390290.593786:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788390290.593790:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788390290.594733:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788390290.594739:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788390290.595450:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788390290.595455:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788390290.596112:0:6469:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788390290.596138:0:6469:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788390290.596145:0:6469:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788390290.596308:0:6469:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788390290.596442:0:6469:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.111@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788390290.596446:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788390290.596448:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788390290.596449:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390290.596450:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390290.596451:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390290.596452:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390290.596458:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788390290.596459:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788390290.596461:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788390290.596473:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788390290.596474:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390290.596476:0:6469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788390290.596478:0:6469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788390290.596481:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788390290.596482:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788390290.596483:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390290.596483:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390290.596484:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390290.596485:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390290.596486:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788390290.596487:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788390290.596488:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788390290.596488:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788390290.596489:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390290.596490:0:6469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788390290.596525:0:6469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788390290.596541:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058fdb729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097929984:0@lo:253: 00000100:00100000:3.0:1788390290.596612:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390290.596669:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097929984 00000100:00100000:2.0:1788390290.596676:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097929984 00000100:00100000:3.0:1788390290.596691:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b32e659 going to sleep for 11 seconds 00000100:00100000:2.0:1788390290.596718:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390290.596726:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcd63d67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+5:6469:x1875263097929984:12345-0@lo:253: 20000000:01000000:2.0:1788390290.596767:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788390290.596770:0:6487:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788390290.596995:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788390290.597019:0:6487:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788390290.597270:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390290.597938:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788390290.598019:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788390290.598023:0:6487:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788390290.598027:0:6487:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788390290.598029:0:6487:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788390290.598040:0:6487:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788390290.598143:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390290.598384:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788390290.598398:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788390290.598417:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788390290.598432:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788390290.598447:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788390290.598513:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788390290.598521:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788390290.598534:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788390290.598539:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788390290.598550:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788390290.598555:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788390290.598568:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788390290.598582:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788390290.598606:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788390290.598611:0:6487:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788390290.598617:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390290.598705:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788390290.598714:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788390290.598727:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788390290.598739:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788390290.598751:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788390290.598759:0:6487:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788390290.598781:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788390290.598788:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788390290.598800:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788390290.598814:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788390290.598826:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788390290.598833:0:6487:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788390290.598854:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788390290.598862:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788390290.598875:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788390290.598889:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788390290.598957:0:6487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788390290.599014:0:6487:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788390290.599021:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788390290.599303:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788390290.599546:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788390290.599564:0:6487:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.111@tcp for mdt 20000000:01000000:3.0:1788390290.599565:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:3.0:1788390290.599579:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788390290.599585:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788390290.599595:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788390290.599600:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:3.0:1788390290.599611:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788390290.599618:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788390290.599628:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788390290.599652:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788390290.599679:0:6487:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788390290.599682:0:6487:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788390290.599685:0:6487:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788390290.599733:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788390290.599735:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788390290.599948:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788390290.600067:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788390290.600084:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788390290.600092:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788390290.600102:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788390290.600103:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788390290.600398:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788390290.600548:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788390290.600566:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788390290.600580:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788390290.600589:0:6487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390290.600592:0:6487:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788390290.600595:0:6487:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788390290.600597:0:6487:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788390290.600601:0:6487:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788390290.600606:0:6487:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788390290.600835:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788390290.600920:0:6487:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788390290.605747:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788390290.605782:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788390290.605797:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788390290.605815:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788390290.605838:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605851:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605859:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605863:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605867:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605871:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605888:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e134b78c already unused, calling callback (00000000a949f04c) 00010000:00010000:2.0:1788390290.605890:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605895:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605904:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605908:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.605911:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e134b78c/0xe156d0713be970ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788390290.605925:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788390290.611762:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcd63d67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+5:6469:x1875263097929984:12345-0@lo:253: Request processed in 15029us (15142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390290.611782:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390290.611868:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058fdb729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097929984:0@lo:253: 10000000:01000000:3.0:1788390290.611883:0:6469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788390290.611886:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390290.611888:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788390290.611889:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390290.611891:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788390290.611892:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390290.611893:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390290.611894:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788390290.611896:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788390290.611898:0:6469:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788390290.611899:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390290.611900:0:6469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788390290.611917:0:6469:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cd39c42f from lustre-MDT0000 10000000:01000000:3.0:1788390290.611946:0:6469:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788390290.611954:0:6469:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788390290.612019:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff984f88c4cd28 10000000:01000000:3.0:1788390290.612025:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390290.612033:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984f88c4cd28 from 1 10000000:01000000:3.0:1788390290.612036:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788390290.612073:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390290.612083:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390290.612091:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390290.612109:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058fdb729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930112:0@lo:101: 00000100:00100000:3.0:1788390290.612144:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390290.612224:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c844fcbc going to sleep for 11 seconds 00000100:00100000:2.0:1788390290.612297:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097930112 00000100:00100000:2.0:1788390290.612303:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097930112 00000100:00100000:2.0:1788390290.612454:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390290.612474:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000464fdf28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+5:6469:x1875263097930112:12345-0@lo:101: 00010000:00010000:2.0:1788390290.612486:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390290.612496:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be970f1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.612515:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be970f1 expref: 6 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.612524:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be970f1 expref: 6 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.612538:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f3c09e4, rc 0) 00000100:00100000:2.0:1788390290.612573:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000464fdf28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+6:6469:x1875263097930112:12345-0@lo:101: Request processed in 112us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390290.612579:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390290.612639:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058fdb729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930112:0@lo:101: 00010000:00010000:1.0:1788390290.612650:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.612668:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390290.612730:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930240:0@lo:501: 00000100:00100000:1.0:1788390290.612776:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.613144:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b679ee2 going to sleep for 11 seconds 00000100:00100000:3.0:1788390290.613198:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097930240 00000100:00100000:3.0:1788390290.613203:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097930240 00000100:00100000:0.0:1788390290.613235:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390290.613242:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d0a3f6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+6:6469:x1875263097930240:12345-0@lo:501: 00000100:00100000:0.0:1788390290.613342:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d0a3f6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+6:6469:x1875263097930240:12345-0@lo:501: Request processed in 78us (542us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390290.613351:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390290.613499:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930240:0@lo:501: 10000000:01000000:1.0:1788390290.613524:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788390290.613542:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.613550:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390290.613558:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984f988e6800 10000000:01000000:1.0:1788390290.613561:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788390290.613565:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff984f988e6800 10000000:01000000:1.0:1788390290.613568:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788390290.613570:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff984f988e6800 from 1 10000000:01000000:1.0:1788390290.613572:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788390290.613589:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 00000000504fe0ce/0xe156d0713be970ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.613595:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 00000000504fe0ce/0xe156d0713be970ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.613603:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 00000000504fe0ce/0xe156d0713be970ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390290.613624:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930368:0@lo:101: 00000100:00100000:1.0:1788390290.613646:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.613660:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b679ee2 going to sleep for 11 seconds 00000100:00100000:0.0:1788390290.613714:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097930368 00000100:00100000:0.0:1788390290.613718:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097930368 00000100:00100000:0.0:1788390290.613736:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390290.613741:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0a9f4f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+6:6469:x1875263097930368:12345-0@lo:101: 00010000:00010000:0.0:1788390290.613753:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390290.613763:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000454fb081/0xe156d0713be97106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be970ff expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390290.613777:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000454fb081/0xe156d0713be97106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be970ff expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390290.613784:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000454fb081/0xe156d0713be97106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be970ff expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390290.613791:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000454fb081, rc 0) 00000100:00100000:0.0:1788390290.613826:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0a9f4f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+7:6469:x1875263097930368:12345-0@lo:101: Request processed in 84us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390290.613832:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390290.613899:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930368:0@lo:101: 00010000:00010000:1.0:1788390290.613908:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 00000000504fe0ce/0xe156d0713be970ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.613915:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 00000000504fe0ce/0xe156d0713be970ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390290.613924:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788390290.613936:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 00000000504fe0ce/0xe156d0713be970ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.613942:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 00000000504fe0ce/0xe156d0713be970ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390290.613948:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788390290.613951:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390290.613955:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff984f988e6800 10000000:01000000:1.0:1788390290.613957:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788390290.614058:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788390290.614060:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788390290.614074:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.614080:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.614098:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390290.614109:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930496:0@lo:101: 00000100:00100000:1.0:1788390290.614132:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.614152:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b679ee2 going to sleep for 11 seconds 00000100:00100000:0.0:1788390290.614195:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097930496 00000100:00100000:0.0:1788390290.614199:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097930496 00000100:00100000:0.0:1788390290.614216:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390290.614221:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e88405a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+7:6469:x1875263097930496:12345-0@lo:101: 00010000:00010000:0.0:1788390290.614227:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390290.614234:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9710d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390290.614246:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9710d expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390290.614252:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9710d expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390290.614258:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008803c279, rc 0) 00000100:00100000:0.0:1788390290.614299:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e88405a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+8:6469:x1875263097930496:12345-0@lo:101: Request processed in 78us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390290.614305:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390290.614410:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930496:0@lo:101: 00010000:00010000:1.0:1788390290.614418:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.614425:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390290.614473:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930624:0@lo:501: 00000100:00100000:1.0:1788390290.614493:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.614537:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b679ee2 going to sleep for 11 seconds 00000100:00100000:2.0:1788390290.614582:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097930624 00000100:00100000:2.0:1788390290.614585:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097930624 00000100:00100000:2.0:1788390290.614600:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390290.614603:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec7fdf31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+8:6469:x1875263097930624:12345-0@lo:501: 00000100:00100000:2.0:1788390290.614677:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec7fdf31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+9:6469:x1875263097930624:12345-0@lo:501: Request processed in 73us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390290.614681:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390290.614728:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930624:0@lo:501: 00000100:00100000:1.0:1788390290.614753:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930752:0@lo:503: 00000100:00100000:1.0:1788390290.614777:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.614792:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b679ee2 going to sleep for 11 seconds 00000100:00100000:3.0:1788390290.614849:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097930752 00000100:00100000:3.0:1788390290.614852:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097930752 00000100:00100000:3.0:1788390290.614863:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390290.614866:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c3e8e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+9:6469:x1875263097930752:12345-0@lo:503: 00000100:00100000:3.0:1788390290.614931:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c3e8e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+9:6469:x1875263097930752:12345-0@lo:503: Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390290.614937:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390290.615107:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097930752:0@lo:503: 00000100:00100000:3.0:1788390290.615489:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:6514:1875263097930880:0@lo:502: 00000100:00100000:3.0:1788390290.615521:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390290.615539:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a196471 going to sleep for 11 seconds 00000100:00100000:1.0:1788390290.615589:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097930880 00000100:00100000:1.0:1788390290.615593:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097930880 00000100:00100000:1.0:1788390290.615618:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390290.615623:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5626b25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+9:6514:x1875263097930880:12345-0@lo:502: 00000100:00100000:1.0:1788390290.615702:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5626b25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+9:6514:x1875263097930880:12345-0@lo:502: Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390290.615709:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390290.615795:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:6514:1875263097930880:0@lo:502: 00000020:01000000:3.0:1788390290.615817:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390290.615825:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390290.615827:0:6514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788390290.615831:0:6514:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788390290.615833:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390290.615849:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c27574df) 00000020:00000080:3.0:1788390290.615863:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788390290.615868:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788390290.615951:0:6514:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788390290.615968:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be97122 00000020:00000080:3.0:1788390290.616182:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788390290.616186:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390290.616193:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390290.616195:0:6514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788390290.616197:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390290.616201:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390290.616202:0:6514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788390290.616209:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390290.616215:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001f385caa) 00000020:00000080:3.0:1788390290.616224:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788390290.616227:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788390290.616228:0:6514:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788390290.616231:0:6514:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788390290.616237:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788390290.616274:0:6514:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cd39c42f from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788390290.616285:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000024703e9e) 00000020:00000080:3.0:1788390290.616293:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788390290.616383:0:6514:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788390290.616396:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be97137 00000020:00000080:3.0:1788390290.616523:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788390290.616529:0:6514:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788390290.616534:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe156d0713be9713e 00080000:01000000:3.0:1788390290.616539:0:6514:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788390290.616547:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be97145 00080000:10000000:3.0:1788390290.616966:0:6514:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788390290.617098:0:6514:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788390290.619766:0:6514:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788390290.677640:0:6514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788390290.678108:0:6514:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788390290.682071:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788390290.682485:0:6514:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788390290.684717:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000aa45eb43) 00000020:00000080:1.0:1788390290.684746:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788390290.684817:0:6514:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788390290.684824:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be97153 00000020:00000080:1.0:1788390290.685403:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788390290.690180:0:6514:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788390290.696836:0:6514:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788390290.698554:0:6514:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1788390290.701043:0:6514:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1788390290.703166:0:6514:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1788390290.704696:0:6514:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788390290.709871:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe156d0713be9715a 00000020:00000080:0.0:1788390290.710393:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788390290.710404:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390290.710410:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390290.710412:0:6514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788390290.710415:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390290.710418:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390290.710420:0:6514:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390290.710422:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390290.710424:0:6514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788390290.710426:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390290.710428:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390290.710430:0:6514:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788390290.710432:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390290.710436:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390290.710437:0:6514:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788390290.710441:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788390290.711682:0:6514:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788390290.711764:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000001bb046 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:6514:1875263097931008:0@lo:502: 00000100:00100000:0.0:1788390290.711838:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390290.711884:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f41da1c7 going to sleep for 11 seconds 00000100:00100000:1.0:1788390290.712035:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097931008 00000100:00100000:1.0:1788390290.712042:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097931008 00000100:00100000:1.0:1788390290.712077:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390290.712085:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072d5005e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+9:6514:x1875263097931008:12345-0@lo:502: 00000100:00100000:1.0:1788390290.712199:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072d5005e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+9:6514:x1875263097931008:12345-0@lo:502: Request processed in 114us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390290.712208:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390290.712229:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000001bb046 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:6514:1875263097931008:0@lo:502: 00000020:01000000:0.0:1788390290.712251:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390290.712256:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390290.712263:0:6514:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788390290.712267:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788390290.712513:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788390290.712532:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788390290.712580:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.712592:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390290.712606:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984f988e6800 from 1 10000000:01000000:1.0:1788390290.712609:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788390290.712632:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.712639:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.712648:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390290.712659:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931136:0@lo:101: 00000100:00100000:1.0:1788390290.712688:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.712747:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbd51009 going to sleep for 11 seconds 00000100:00100000:2.0:1788390290.712799:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097931136 00000100:00100000:2.0:1788390290.712803:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097931136 00000100:00100000:2.0:1788390290.712859:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390290.712866:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025437dcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+9:6469:x1875263097931136:12345-0@lo:101: 00010000:00010000:2.0:1788390290.712874:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390290.712886:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97161 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.712904:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97161 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.712912:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97161 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.712919:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e134b78c, rc 0) 00000100:00100000:2.0:1788390290.712954:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025437dcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+10:6469:x1875263097931136:12345-0@lo:101: Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390290.712975:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788390290.713025:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931136:0@lo:101: 00010000:00010000:1.0:1788390290.713034:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.713041:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390290.713632:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931264:0@lo:256: 00000100:00100000:1.0:1788390290.713671:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.714071:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbd51009 going to sleep for 11 seconds 00000100:00100000:0.0:1788390290.714130:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097931264 00000100:00100000:0.0:1788390290.714136:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097931264 00000100:00100000:0.0:1788390290.714161:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390290.714167:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000add925df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+10:6469:x1875263097931264:12345-0@lo:256: 20000000:01000000:0.0:1788390290.714182:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788390290.714187:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788390290.714256:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000add925df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+10:6469:x1875263097931264:12345-0@lo:256: Request processed in 89us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390290.714263:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390290.714355:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931264:0@lo:256: 10000000:01000000:1.0:1788390290.714917:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788390290.714932:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.714949:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390290.714968:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984f988e6800 from 1 10000000:01000000:1.0:1788390290.714971:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390290.714995:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.715002:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.715010:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390290.715022:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931392:0@lo:101: 00000100:00100000:1.0:1788390290.715051:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.715070:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbd51009 going to sleep for 11 seconds 00000100:00100000:0.0:1788390290.715189:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097931392 00000100:00100000:0.0:1788390290.715194:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097931392 00000100:00100000:0.0:1788390290.715217:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390290.715224:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e80fe8a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+10:6469:x1875263097931392:12345-0@lo:101: 00010000:00010000:0.0:1788390290.715232:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390290.715243:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9716f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390290.715259:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9716f expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390290.715267:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9716f expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390290.715275:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000639dafca, rc 0) 00000100:00100000:0.0:1788390290.715310:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e80fe8a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+11:6469:x1875263097931392:12345-0@lo:101: Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390290.715316:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788390290.715414:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931392:0@lo:101: 00010000:00010000:1.0:1788390290.715424:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.715432:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390290.715521:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931520:0@lo:501: 00000100:00100000:1.0:1788390290.715545:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.715600:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbd51009 going to sleep for 11 seconds 00000100:00100000:2.0:1788390290.715716:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097931520 00000100:00100000:2.0:1788390290.715721:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097931520 00000100:00100000:0.0:1788390290.715777:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390290.715783:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad97edf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+11:6469:x1875263097931520:12345-0@lo:501: 00000100:00100000:0.0:1788390290.716056:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad97edf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+11:6469:x1875263097931520:12345-0@lo:501: Request processed in 273us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390290.716063:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390290.716188:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931520:0@lo:501: 00000100:00100000:1.0:1788390290.716212:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931648:0@lo:503: 00000100:00100000:1.0:1788390290.716244:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.716294:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbd51009 going to sleep for 11 seconds 00000100:00100000:1.0:1788390290.716308:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097931648 00000100:00100000:1.0:1788390290.716311:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097931648 00000100:00100000:2.0:1788390290.716454:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390290.716485:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000399cc12b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+11:6469:x1875263097931648:12345-0@lo:503: 00000040:00080000:2.0:1788390290.716515:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390290.716595:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000399cc12b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+11:6469:x1875263097931648:12345-0@lo:503: Request processed in 134us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390290.716601:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390290.716717:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e1e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931648:0@lo:503: 00000040:00080000:2.0:1788390290.717724:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788390290.717900:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788390290.717925:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390290.717943:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390290.717953:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390290.718015:0:6469:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788390290.718018:0:6469:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984f988e6800 10000000:01000000:3.0:1788390290.718021:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984f988e6800 10000000:01000000:3.0:1788390290.718025:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390290.718030:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984f988e6800 from 1 10000000:01000000:3.0:1788390290.718033:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390290.718058:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390290.718065:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390290.718073:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390290.718089:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931776:0@lo:101: 00000100:00100000:3.0:1788390290.718135:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390290.718179:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068319a82 going to sleep for 11 seconds 00000100:00100000:2.0:1788390290.718308:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097931776 00000100:00100000:2.0:1788390290.718314:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097931776 00000100:00100000:2.0:1788390290.718441:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390290.718449:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093227016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+11:6469:x1875263097931776:12345-0@lo:101: 00010000:00010000:2.0:1788390290.718459:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390290.718491:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9717d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.718513:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9717d expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.718520:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9717d expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.718529:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e6408fd, rc 0) 00000100:00100000:2.0:1788390290.718559:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093227016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6469:x1875263097931776:12345-0@lo:101: Request processed in 112us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390290.718565:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788390290.718663:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931776:0@lo:101: 00010000:00010000:3.0:1788390290.718674:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390290.718682:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390290.718728:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931904:0@lo:501: 00000100:00100000:3.0:1788390290.718749:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390290.718773:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068319a82 going to sleep for 11 seconds 00000100:00100000:2.0:1788390290.718816:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097931904 00000100:00100000:2.0:1788390290.718820:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097931904 00000100:00100000:2.0:1788390290.718837:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390290.718841:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fed60a2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6469:x1875263097931904:12345-0@lo:501: 00000100:00100000:2.0:1788390290.718942:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fed60a2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6469:x1875263097931904:12345-0@lo:501: Request processed in 100us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390290.718948:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788390290.719069:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097931904:0@lo:501: 00000100:00100000:3.0:1788390290.719095:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097932032:0@lo:503: 00000100:00100000:3.0:1788390290.719128:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390290.719148:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068319a82 going to sleep for 11 seconds 00000100:00100000:2.0:1788390290.719192:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097932032 00000100:00100000:2.0:1788390290.719196:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097932032 00000100:00100000:2.0:1788390290.719212:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390290.719216:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006466bd80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6469:x1875263097932032:12345-0@lo:503: 00000100:00100000:2.0:1788390290.719437:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006466bd80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6469:x1875263097932032:12345-0@lo:503: Request processed in 219us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390290.719443:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788390290.719599:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097932032:0@lo:503: 00000100:00100000:3.0:1788390290.720048:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:6519:1875263097932160:0@lo:502: 00000100:00100000:3.0:1788390290.720084:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390290.720140:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010fa1ccc going to sleep for 11 seconds 00000100:00100000:1.0:1788390290.720176:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097932160 00000100:00100000:1.0:1788390290.720181:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097932160 00000100:00100000:1.0:1788390290.720238:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390290.720245:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa99feb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6519:x1875263097932160:12345-0@lo:502: 00000100:00100000:1.0:1788390290.720364:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa99feb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6519:x1875263097932160:12345-0@lo:502: Request processed in 120us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390290.720372:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788390290.720442:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:6519:1875263097932160:0@lo:502: 00000020:01000004:3.0:1788390290.720514:0:6519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788390290.720529:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d7c76827) 00000020:00000080:3.0:1788390290.720546:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788390290.720630:0:6519:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cd39c42f from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788390290.720634:0:6519:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000cd39c42f from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788390290.720636:0:6519:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000cd39c42f 4 00010000:00080000:3.0:1788390290.720668:0:6519:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000aaeb5a06@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.111@tcp at head 00010000:00010000:3.0:1788390290.723120:0:6519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788390290.723455:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788390290.725541:0:6519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788390290.725558:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe156d0713be97192 00000100:00080000:2.0:1788390290.725568:0:6519:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390290.725573:0:6519:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aaeb5a06 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390290.725621:0:6519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ce91f2c2 x1875263097932288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788390290.725675:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce91f2c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263097932288:0@lo:38: 00000100:00100000:0.0:1788390290.725740:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.725832:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097932288 00000100:00100000:1.0:1788390290.725840:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097932288 00000100:00080000:2.0:1788390290.725873:0:6519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788390290.727072:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390290.727080:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000001bb046 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875263097932288:12345-0@lo:38: 00000100:00100000:2.0:1788390290.729208:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c342ccc pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:6519:1875263097932416:0@lo:502: 00000100:00100000:2.0:1788390290.729275:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390290.729299:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df9eeb26 going to sleep for 11 seconds 00000100:00100000:0.0:1788390290.729501:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097932416 00000100:00100000:0.0:1788390290.729509:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097932416 00000100:00100000:0.0:1788390290.730032:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788390290.730041:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a89689d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6519:x1875263097932416:12345-0@lo:502: 00000100:00100000:0.0:1788390290.730151:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a89689d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6519:x1875263097932416:12345-0@lo:502: Request processed in 111us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390290.730158:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390290.730248:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000001bb046 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875263097932288:12345-0@lo:38: Request processed in 3167us (4507us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788390290.730256:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390290.731180:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390290.731187:0:3621:0:(import.c:65:import_set_state_nolock()) 00000000aaeb5a06 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390290.731192:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788390290.731194:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce91f2c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263097932288:0@lo:38: 00000100:00100000:2.0:1788390290.731305:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c342ccc pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:6519:1875263097932416:0@lo:502: 00000040:00080000:2.0:1788390290.731354:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788390290.731500:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788390290.731521:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390290.731536:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390290.731554:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788390290.731597:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788390290.731600:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788390290.731602:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390290.731603:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390290.731604:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390290.731605:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390290.731607:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390290.731608:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788390290.731609:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390290.731610:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390290.731612:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390290.731613:0:6469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390290.731616:0:6469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788390290.731619:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390290.731620:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788390290.731621:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390290.731622:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390290.731623:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390290.731624:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390290.731625:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390290.731626:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788390290.731627:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390290.731628:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390290.731629:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390290.731630:0:6469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390290.731647:0:6469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788390290.731658:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4ca8c24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097932544:0@lo:253: 00000100:00100000:1.0:1788390290.731703:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390290.731743:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5746b5f going to sleep for 11 seconds 00000100:00100000:2.0:1788390290.731855:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097932544 00000100:00100000:2.0:1788390290.731867:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097932544 00000100:00100000:2.0:1788390290.731909:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788390290.731918:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d3d8792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6469:x1875263097932544:12345-0@lo:253: 20000000:01000000:2.0:1788390290.731938:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788390290.731952:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788390290.735799:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788390290.735835:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788390290.736212:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d3d8792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6469:x1875263097932544:12345-0@lo:253: Request processed in 4293us (4505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390290.736232:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:2.0:1788390290.736298:0:6508:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788390290.736304:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788390290.736370:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.736384:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97161 expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.736390:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.736425:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97161 expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.736438:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97161 expref: 11 pid: 6487 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390290.736450:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c342ccc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097932672:0@lo:104: 00000100:00100000:2.0:1788390290.736503:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390290.736565:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7fc0084 going to sleep for 11 seconds 00000100:00100000:3.0:1788390290.736659:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097932672 00000100:00100000:3.0:1788390290.736666:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097932672 00000100:00100000:3.0:1788390290.736706:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390290.736714:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051327790 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6508:x1875263097932672:12345-0@lo:104: 00010000:00010000:3.0:1788390290.736725:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390290.736764:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390290.736769:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051327790 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6508:x1875263097932672:12345-0@lo:104: Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390290.736775:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390290.736844:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c342ccc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097932672:0@lo:104: 00010000:00010000:1.0:1788390290.736859:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.736912:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390290.736917:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.736924:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2c88e7d already unused, calling callback (00000000cea255f4) 10000000:00010000:2.0:1788390290.736927:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.736940:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390290.736947:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390290.736952:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390290.736996:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737002:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390290.737022:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737028:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: 00000000d2c88e7d/0xe156d0713be97161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97168 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737043:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390290.737044:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390290.737046:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390290.737169:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000823681b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097932800:0@lo:103: 00000100:00100000:1.0:1788390290.737197:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390290.737341:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097932800 00000100:00100000:2.0:1788390290.737345:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097932800 00010000:00010000:2.0:1788390290.737361:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97161 expref: 12 pid: 6487 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390290.737391:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390290.737397:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044b19efc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:3623:x1875263097932800:12345-0@lo:103: 00010000:00010000:2.0:1788390290.737409:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390290.737414:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97161 expref: 12 pid: 6487 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737429:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97161 expref: 12 pid: 6487 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737442:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e134b78c/0xe156d0713be97168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97161 expref: 12 pid: 6487 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737453:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737459:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788390290.737482:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001178984s 00010000:00010000:2.0:1788390290.737485:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737491:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737497:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737503:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737508:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006814e59b already unused, calling callback (00000000a949f04c) 00010000:00010000:2.0:1788390290.737511:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737517:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737537:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737546:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390290.737574:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044b19efc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+11:3623:x1875263097932800:12345-0@lo:103: Request processed in 178us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390290.737581:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390290.737607:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000823681b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097932800:0@lo:103: 00010000:00010000:2.0:1788390290.737623:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737630:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390290.737635:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006814e59b/0xe156d0713be97199 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390290.737870:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4ca8c24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:6469:1875263097932544:0@lo:253: 10000000:01000000:0.0:1788390290.737880:0:6469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788390290.737883:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390290.737884:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390290.737886:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390290.737887:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390290.737888:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390290.737889:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390290.737890:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390290.737892:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390290.737893:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788390290.737894:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788390290.737895:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390290.737897:0:6469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788390290.737905:0:6469:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788390290.742836:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788390290.743021:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788390290.743221:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788390290.743399:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788390290.743592:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788390290.743733:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788390290.744858:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788390290.745071:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788390290.745226:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788390290.745527:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788390290.745711:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788390290.745858:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788390290.748161:0:6469:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788390290.758554:0:6469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788390290.758797:0:6525:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788390290.759985:0:6469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788390290.760080:0:6469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788390290.760547:0:6469:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788390290.760553:0:6469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788390290.760641:0:6469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788390290.763172:0:6524:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788390290.763180:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1788390290.763242:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390290.764727:0:6469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788390290.766410:0:6469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788390290.766484:0:6469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788390290.767673:0:6525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788390290.767731:0:6525:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788390290.767735:0:6525:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788390290.768086:0:6469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788390290.768306:0:6469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788390290.768950:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788390290.769060:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788390290.769194:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788390290.769382:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788390290.769532:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788390290.769654:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788390290.769789:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788390290.769905:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788390290.770010:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788390290.770122:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788390290.770260:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788390290.770412:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788390290.770678:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788390290.770787:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788390290.770906:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788390290.771017:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788390290.771273:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788390290.771532:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788390290.771673:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788390290.771799:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788390290.771926:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788390290.772059:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788390290.772234:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788390290.772478:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788390290.772604:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788390290.772762:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788390290.772893:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788390290.773025:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788390290.773148:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788390290.773285:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788390290.774542:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788390290.774685:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788390290.774871:0:6469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788390290.784418:0:6469:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788390290.784457:0:6469:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4a7c1cc3988 00100000:10000000:2.0:1788390290.784475:0:6469:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788390290.786919:0:6469:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788390290.786932:0:6469:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788390290.786948:0:6469:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788390290.786976:0:6469:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788390290.787637:0:6469:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788390290.787775:0:6469:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788390291.602788:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390292.625454:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390293.651516:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390293.785551:0:6770:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1788390294.537012:0:6822:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788390294.537176:0:6822:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788390294.674286:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390295.697471:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390296.145750:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1788390296.145773:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788390296.145778:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788390296.145781:0:36:0:(import.c:65:import_set_state_nolock()) 00000000aaeb5a06 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390296.145792:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aaeb5a06 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390296.145812:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006cc76a66 x1875263097933056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788390296.145971:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263097933056:0@lo:38: 00000100:00100000:0.0:1788390296.146040:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390296.146178:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097933056 00000100:00100000:2.0:1788390296.146185:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097933056 00000100:00100000:2.0:1788390296.146219:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390296.146225:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ca52dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263097933056:12345-0@lo:38: 00010000:00080000:2.0:1788390296.146248:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 116 last 0 00000020:00000080:2.0:1788390296.146280:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe156d0713be971a0 00000004:00100000:2.0:1788390296.146340:0:6494:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788390296.146459:0:6494:0:(import.c:65:import_set_state_nolock()) 00000000baa631c2 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390296.146512:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ca52dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875263097933056:12345-0@lo:38: Request processed in 287us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390296.146532:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788390296.146607:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006cc76a66 x1875263097933056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788390296.146622:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788390296.146627:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788390296.146632:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788390296.146633:0:3621:0:(import.c:65:import_set_state_nolock()) 00000000aaeb5a06 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788390296.146638:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263097933056:0@lo:38: 00000100:00100000:3.0:1788390296.146849:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000823681b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097932928:0@lo:400: 00000100:00100000:3.0:1788390296.146880:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390296.146991:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097932928 00000100:00100000:2.0:1788390296.146996:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097932928 00000100:00100000:2.0:1788390296.147056:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788390296.147062:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcfa3090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+11:3625:x1875263097932928:12345-0@lo:400: 00000100:00100000:2.0:1788390296.147100:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcfa3090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+11:3625:x1875263097932928:12345-0@lo:400: Request processed in 39us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390296.147107:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390296.147158:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000823681b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097932928:0@lo:400: 00010000:00010000:2.0:1788390296.721496:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788390296.999246:0:6923:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390296.999601:0:6923:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788390297.747781:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390298.769441:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390299.794601:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788390300.261115:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788390300.261125:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984f988e6800 from 3 10000000:01000000:0.0:1788390300.261130:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788390300.261181:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390300.261206:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390300.261217:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390300.261241:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4824d33 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097933184:0@lo:101: 00000100:00100000:0.0:1788390300.261307:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390300.261413:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a52fce07 going to sleep for 11 seconds 00000100:00100000:1.0:1788390300.261617:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097933184 00000100:00100000:1.0:1788390300.261626:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097933184 00000100:00100000:1.0:1788390300.261684:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390300.261693:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056977cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+11:6489:x1875263097933184:12345-0@lo:101: 00010000:00010000:1.0:1788390300.261720:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390300.261734:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be971a7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390300.261755:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be971a7 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390300.261764:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be971a7 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390300.261788:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009526ea3e, rc 0) 00000100:00100000:1.0:1788390300.261838:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056977cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6489:x1875263097933184:12345-0@lo:101: Request processed in 146us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390300.261845:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390300.262005:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4824d33 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097933184:0@lo:101: 00010000:00010000:3.0:1788390300.262020:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390300.262029:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390300.262078:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097933312:0@lo:256: 00000100:00100000:3.0:1788390300.262112:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390300.262137:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fdcffa09 going to sleep for 11 seconds 00000100:00100000:2.0:1788390300.262207:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097933312 00000100:00100000:2.0:1788390300.262213:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097933312 00000100:00100000:2.0:1788390300.262244:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788390300.262250:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000086538be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6489:x1875263097933312:12345-0@lo:256: 20000000:01000000:2.0:1788390300.262262:0:6487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788390300.262278:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788390300.262281:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788390300.262392:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000086538be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:6489:x1875263097933312:12345-0@lo:256: Request processed in 142us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390300.262399:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390300.262520:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097933312:0@lo:256: 10000000:01000000:3.0:1788390300.262557:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390300.262562:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390300.262570:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390300.818720:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390301.265558:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390301.265582:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b4581a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875263097933568:0@lo:400: 00000100:00100000:2.0:1788390301.265655:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390301.265804:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390301.265815:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb2ba791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097933440:0@lo:400: 00000100:00100000:1.0:1788390301.265850:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390301.265895:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097933568 00000100:00100000:1.0:1788390301.265903:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097933568 00000100:00100000:1.0:1788390301.265945:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390301.265953:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f61a4a98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875263097933568:12345-0@lo:400: 00000100:00100000:1.0:1788390301.266005:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f61a4a98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875263097933568:12345-0@lo:400: Request processed in 52us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390301.266011:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788390301.266072:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003b4581a8 x1875263097933568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390301.266086:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b4581a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875263097933568:0@lo:400: 00000100:00100000:2.0:1788390301.266270:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097933440 00000100:00100000:2.0:1788390301.266275:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097933440 00000100:00100000:2.0:1788390301.266313:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390301.266345:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003875400c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:3624:x1875263097933440:12345-0@lo:400: 00000100:00100000:2.0:1788390301.266406:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003875400c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:3624:x1875263097933440:12345-0@lo:400: Request processed in 87us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390301.266413:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390301.266489:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb2ba791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097933440:0@lo:400: 00010000:00010000:0.0:1788390301.841512:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390302.865463:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390303.891472:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390304.921892:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390305.937570:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390306.387006:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390306.387029:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002cdf2dcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097933696:0@lo:400: 00000100:00100000:2.0:1788390306.387102:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390306.387152:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263097933824:0@lo:400: 00000100:00100000:2.0:1788390306.387180:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390306.387217:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097933696 00000100:00100000:2.0:1788390306.387225:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097933696 00000100:00100000:2.0:1788390306.387269:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390306.387277:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038c8983e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+12:3622:x1875263097933696:12345-0@lo:400: 00000100:00100000:2.0:1788390306.387350:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038c8983e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+12:3622:x1875263097933696:12345-0@lo:400: Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.387357:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390306.387510:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097933824 00000100:00100000:2.0:1788390306.387515:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097933824 00000100:00100000:2.0:1788390306.387545:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390306.387551:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ba4e741 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263097933824:12345-0@lo:400: 00000100:00100000:2.0:1788390306.387590:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ba4e741 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263097933824:12345-0@lo:400: Request processed in 39us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.387596:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390306.387631:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002cdf2dcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097933696:0@lo:400: 00010000:00080000:2.0:1788390306.387664:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000b9f56b6 x1875263097933824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390306.387695:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263097933824:0@lo:400: 00000020:01000004:0.0:1788390306.553687:0:7422:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788390306.553690:0:7422:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788390306.553692:0:7422:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788390306.553844:0:7422:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000071e8e9eb 00000020:01000004:0.0:1788390306.553866:0:7422:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788390306.553877:0:7422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788390306.553891:0:7422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000058b753a2) 00000020:00000080:0.0:1788390306.553910:0:7422:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788390306.634106:0:7422:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788390306.634198:0:7422:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788390306.676128:0:7422:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788390306.677476:0:7422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788390306.677490:0:7422:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788390306.677502:0:7422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be971bc 00000020:01000004:2.0:1788390306.677510:0:7422:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788390306.677530:0:7422:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788390306.677533:0:7422:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788390306.677538:0:7422:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788390306.677570:0:7422:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788390306.677574:0:7422:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788390306.715473:0:7422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788390306.715514:0:7422:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.111@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788390306.715519:0:7422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788390306.715521:0:7422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788390306.715522:0:7422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390306.715523:0:7422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390306.715524:0:7422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390306.715525:0:7422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390306.715527:0:7422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390306.715528:0:7422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390306.715529:0:7422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390306.715531:0:7422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390306.715532:0:7422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390306.715536:0:7422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788390306.715538:0:7422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390306.715539:0:7422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788390306.715540:0:7422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390306.715541:0:7422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390306.715542:0:7422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390306.715543:0:7422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390306.715544:0:7422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390306.715544:0:7422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390306.715545:0:7422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390306.715546:0:7422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390306.715547:0:7422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390306.715574:0:7422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788390306.715594:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acb308d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097933952:0@lo:253: 00000100:00100000:1.0:1788390306.715667:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390306.715715:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036d5635e going to sleep for 11 seconds 00000100:00100000:0.0:1788390306.717224:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097933952 00000100:00100000:0.0:1788390306.717234:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097933952 00000100:00100000:0.0:1788390306.717346:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390306.717356:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016b77ed1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097933952:12345-0@lo:253: 20000000:01000000:0.0:1788390306.717389:0:6484:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788390306.717394:0:6484:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788390306.717399:0:6484:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788390306.717402:0:6484:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788390306.717441:0:6484:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788390306.717657:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390306.717788:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788390306.717804:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788390306.722985:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788390306.723025:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788390306.723044:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788390306.723142:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788390306.723154:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788390306.723171:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788390306.723178:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788390306.723189:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788390306.723195:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788390306.723210:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788390306.723226:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788390306.723347:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788390306.723357:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:0.0:1788390306.723390:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788390306.723398:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788390306.723411:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788390306.723416:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:0.0:1788390306.723430:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788390306.723445:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788390306.723460:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788390306.723476:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788390306.723486:0:6484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788390306.723563:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788390306.723573:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788390306.723586:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788390306.723602:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788390306.723619:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788390306.723625:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788390306.723635:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788390306.723654:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788390306.723660:0:6484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788390306.723679:0:6484:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788390306.723685:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788390306.726640:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788390306.726775:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788390306.726801:0:6484:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.111@tcp for mdt 20000000:01000000:1.0:1788390306.726803:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:1.0:1788390306.728932:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788390306.728960:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788390306.728984:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788390306.728993:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:1.0:1788390306.729014:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788390306.729022:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788390306.729034:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788390306.729050:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1788390306.729118:0:6484:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1788390306.729127:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788390306.735080:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788390306.735386:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788390306.735416:0:6484:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.111@tcp for mdt 20000000:01000000:2.0:1788390306.735420:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:2.0:1788390306.735437:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788390306.735445:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788390306.735485:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788390306.735493:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:2.0:1788390306.735507:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788390306.735514:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788390306.735525:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788390306.735540:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788390306.735567:0:6484:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788390306.735570:0:6484:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788390306.735574:0:6484:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788390306.735640:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788390306.735651:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788390306.737267:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788390306.737311:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788390306.737360:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788390306.737568:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788390306.737594:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788390306.737615:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788390306.737626:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788390306.737629:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788390306.739034:0:7431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788390306.739075:0:7431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788390306.739090:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788390306.739430:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788390306.739452:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788390306.739469:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788390306.739480:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788390306.739482:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788390306.740016:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788390306.740036:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788390306.740050:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788390306.740175:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1788390306.740195:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1788390306.740212:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1788390306.740225:0:6484:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788390306.740228:0:6484:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788390306.740233:0:6484:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788390306.740240:0:6484:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788390306.740628:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788390306.740725:0:6484:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788390306.754966:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788390306.757366:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.757387:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be970f1 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.757395:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9710d expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.757401:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9717d expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.757407:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.757451:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9717d expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.757474:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9717d expref: 12 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390306.757490:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097934080:0@lo:104: 00000100:00100000:3.0:1788390306.757553:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390306.757606:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9710d expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.757614:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9710d expref: 12 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390306.757623:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000976e0434 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097934208:0@lo:104: 00000100:00100000:3.0:1788390306.757643:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390306.757663:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be970f1 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.757670:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be970f1 expref: 12 pid: 6486 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390306.757678:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012fea21a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097934336:0@lo:104: 00000100:00100000:3.0:1788390306.757696:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390306.757704:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9624818 going to sleep for 11 seconds 00000100:00100000:2.0:1788390306.757771:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097934080 00000100:00100000:2.0:1788390306.757779:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097934080 00000100:00100000:2.0:1788390306.757823:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097934208 00000100:00100000:2.0:1788390306.757826:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097934208 00000100:00100000:2.0:1788390306.757837:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097934336 00000100:00100000:2.0:1788390306.757840:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097934336 00000100:00100000:2.0:1788390306.757851:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390306.757859:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9878374 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+5:6484:x1875263097934080:12345-0@lo:104: 00010000:00010000:2.0:1788390306.757869:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.757926:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390306.757930:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9878374 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+5:6484:x1875263097934080:12345-0@lo:104: Request processed in 73us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.757937:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390306.757952:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390306.757957:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bee94305 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6484:x1875263097934208:12345-0@lo:104: 00010000:00010000:2.0:1788390306.757963:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.757993:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788390306.757997:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bee94305 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6484:x1875263097934208:12345-0@lo:104: Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.758011:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390306.758022:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390306.758026:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018e2605d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6484:x1875263097934336:12345-0@lo:104: 00010000:00010000:2.0:1788390306.758033:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758055:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788390306.758059:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018e2605d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6484:x1875263097934336:12345-0@lo:104: Request processed in 33us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.758064:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788390306.758077:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788390306.758082:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758089:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000013317e01 already unused, calling callback (00000000cea255f4) 10000000:00010000:2.0:1788390306.758092:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758101:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390306.758108:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390306.758113:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390306.758136:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758142:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390306.758165:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758171:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: 0000000013317e01/0xe156d0713be9717d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97184 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758186:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390306.758188:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758194:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e7d62b56 already unused, calling callback (00000000cea255f4) 10000000:00010000:2.0:1788390306.758196:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758202:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390306.758207:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390306.758212:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390306.758222:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758228:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390306.758239:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758245:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: 00000000e7d62b56/0xe156d0713be9710d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97114 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758254:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390306.758261:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758267:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000070e1f610 already unused, calling callback (00000000cea255f4) 10000000:00010000:2.0:1788390306.758269:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758274:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390306.758279:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390306.758284:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390306.758296:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758302:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390306.758306:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758312:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be970f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be970f8 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758355:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390306.758357:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390306.758359:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390306.758364:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390306.758374:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097934464:0@lo:103: 00000100:00100000:2.0:1788390306.758401:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390306.758435:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002cdf2dcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097934592:0@lo:103: 00000100:00100000:2.0:1788390306.758464:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390306.758482:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390306.758487:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000049f383d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097934720:0@lo:103: 00000100:00100000:2.0:1788390306.758506:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390306.758532:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097934464 00000100:00100000:2.0:1788390306.758536:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097934464 00010000:00010000:2.0:1788390306.758552:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9717d expref: 13 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390306.758565:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097934592 00000100:00100000:2.0:1788390306.758568:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097934592 00010000:00010000:2.0:1788390306.758576:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9710d expref: 14 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390306.758586:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097934720 00000100:00100000:2.0:1788390306.758588:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097934720 00010000:00010000:2.0:1788390306.758595:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be970f1 expref: 15 pid: 6486 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390306.758606:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390306.758611:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b6d579c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3625:x1875263097934464:12345-0@lo:103: 00010000:00010000:2.0:1788390306.758619:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390306.758623:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9717d expref: 15 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758632:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9717d expref: 15 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758645:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390306.758668:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b6d579c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3625:x1875263097934464:12345-0@lo:103: Request processed in 58us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.758682:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390306.758695:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390306.758700:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a863addd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:3622:x1875263097934592:12345-0@lo:103: 00010000:00010000:2.0:1788390306.758707:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390306.758710:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9710d expref: 14 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758718:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9710d expref: 14 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758727:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390306.758748:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a863addd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:3622:x1875263097934592:12345-0@lo:103: Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.758754:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390306.758764:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390306.758769:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a136c18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+13:3622:x1875263097934720:12345-0@lo:103: 00010000:00010000:2.0:1788390306.758775:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390306.758778:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be970f1 expref: 13 pid: 6486 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758786:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be970f1 expref: 13 pid: 6486 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758795:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758801:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758821:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758827:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758833:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758839:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758844:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005480cbed already unused, calling callback (00000000a949f04c) 00010000:00010000:2.0:1788390306.758847:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758853:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758859:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.758867:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390306.758888:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a136c18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+13:3622:x1875263097934720:12345-0@lo:103: Request processed in 119us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.758894:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390306.758929:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097934464:0@lo:103: 00000100:00100000:2.0:1788390306.758952:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000049f383d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097934720:0@lo:103: 00000100:00100000:2.0:1788390306.758957:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002cdf2dcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097934592:0@lo:103: 00010000:00010000:3.0:1788390306.759366:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004e6408fd/0xe156d0713be97184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9717d expref: 12 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390306.759376:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097934080:0@lo:104: 00010000:00010000:3.0:1788390306.759385:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008803c279/0xe156d0713be97114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9710d expref: 11 pid: 6487 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390306.759403:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000976e0434 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097934208:0@lo:104: 00010000:00010000:3.0:1788390306.759414:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004f3c09e4/0xe156d0713be970f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be970f1 expref: 10 pid: 6486 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390306.759422:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012fea21a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097934336:0@lo:104: 00010000:00010000:3.0:1788390306.759437:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.759444:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.759449:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390306.759455:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005480cbed/0xe156d0713be971c3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788390306.759471:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788390306.768133:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016b77ed1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+9:7422:x1875263097933952:12345-0@lo:253: Request processed in 50771us (52458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.768148:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390306.768248:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acb308d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097933952:0@lo:253: 10000000:01000000:0.0:1788390306.768279:0:7422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788390306.768282:0:7422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390306.768283:0:7422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788390306.768285:0:7422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390306.768286:0:7422:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788390306.768287:0:7422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390306.768288:0:7422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390306.768289:0:7422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390306.768291:0:7422:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788390306.768292:0:7422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390306.768294:0:7422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788390306.768311:0:7422:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000071e8e9eb from lustre-MDT0001 10000000:01000000:0.0:1788390306.768370:0:7422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788390306.768373:0:7422:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788390306.768379:0:7422:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984f88c4cd28 local copy 10000000:01000000:0.0:1788390306.768383:0:7422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788390306.768415:0:7422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390306.768426:0:7422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390306.768434:0:7422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390306.768452:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfe154ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097934848:0@lo:101: 00000100:00100000:0.0:1788390306.768487:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390306.768521:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c97df18 going to sleep for 11 seconds 00000100:00100000:2.0:1788390306.769401:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097934848 00000100:00100000:2.0:1788390306.769409:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097934848 00000100:00100000:2.0:1788390306.769457:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788390306.769465:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bd62c99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+9:7422:x1875263097934848:12345-0@lo:101: 00010000:00010000:2.0:1788390306.769478:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390306.769491:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006814e59b/0xe156d0713be971d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be971ca expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.769514:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006814e59b/0xe156d0713be971d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be971ca expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.769524:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006814e59b/0xe156d0713be971d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be971ca expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.769533:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006814e59b, rc 0) 00000100:00100000:2.0:1788390306.769568:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bd62c99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+10:7422:x1875263097934848:12345-0@lo:101: Request processed in 104us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.769574:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390306.769644:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfe154ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097934848:0@lo:101: 00010000:00010000:0.0:1788390306.769656:0:7422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390306.769676:0:7422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390306.769760:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfe154ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097934976:0@lo:501: 00000100:00100000:0.0:1788390306.769785:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390306.769808:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c97df18 going to sleep for 11 seconds 00000100:00100000:2.0:1788390306.770598:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097934976 00000100:00100000:2.0:1788390306.770604:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097934976 00000100:00100000:2.0:1788390306.770639:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390306.770645:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ff79000 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+10:7422:x1875263097934976:12345-0@lo:501: 00000100:00100000:2.0:1788390306.770710:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ff79000 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+10:7422:x1875263097934976:12345-0@lo:501: Request processed in 66us (925us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390306.770718:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390306.770900:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfe154ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097934976:0@lo:501: 10000000:01000000:1.0:1788390306.770912:0:7422:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788390306.770934:0:7422:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788390306.770938:0:7422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.770946:0:7422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.770952:0:7422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.770972:0:7422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788390306.771000:0:7422:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984fb76a1000 10000000:01000000:1.0:1788390306.771005:0:7422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788390306.771009:0:7422:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff984f88c4cd28 10000000:01000000:1.0:1788390306.771012:0:7422:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788390306.771015:0:7422:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff984f88c4cd28 from 1 10000000:01000000:1.0:1788390306.771018:0:7422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788390306.771035:0:7422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 000000001efb8f6a/0xe156d0713be971d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771052:0:7422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 000000001efb8f6a/0xe156d0713be971d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771059:0:7422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 000000001efb8f6a/0xe156d0713be971d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390306.771071:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935104:0@lo:101: 00000100:00100000:1.0:1788390306.771099:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390306.771127:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e4e32f6 going to sleep for 11 seconds 00000100:00100000:0.0:1788390306.771166:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097935104 00000100:00100000:0.0:1788390306.771170:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097935104 00000100:00100000:0.0:1788390306.771202:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788390306.771208:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dda75e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+10:7422:x1875263097935104:12345-0@lo:101: 00010000:00010000:0.0:1788390306.771215:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390306.771225:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080ffa2d2/0xe156d0713be971df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be971d8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390306.771238:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080ffa2d2/0xe156d0713be971df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be971d8 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390306.771247:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080ffa2d2/0xe156d0713be971df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be971d8 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390306.771253:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080ffa2d2, rc 0) 00000100:00100000:0.0:1788390306.771277:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dda75e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+11:7422:x1875263097935104:12345-0@lo:101: Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390306.771283:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788390306.771366:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935104:0@lo:101: 00010000:00010000:1.0:1788390306.771376:0:7422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 000000001efb8f6a/0xe156d0713be971d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971df expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771383:0:7422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 000000001efb8f6a/0xe156d0713be971d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be971df expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390306.771397:0:7422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788390306.771409:0:7422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 000000001efb8f6a/0xe156d0713be971d8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971df expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771414:0:7422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 000000001efb8f6a/0xe156d0713be971d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971df expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390306.771421:0:7422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff984fb76a1000 10000000:01000000:1.0:1788390306.771424:0:7422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788390306.771427:0:7422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff984fb76a1000 from 1 10000000:01000000:1.0:1788390306.771429:0:7422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788390306.771441:0:7422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 00000000e111b455/0xe156d0713be971e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771452:0:7422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 00000000e111b455/0xe156d0713be971e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771458:0:7422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 00000000e111b455/0xe156d0713be971e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390306.771468:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935232:0@lo:101: 00000100:00100000:1.0:1788390306.771491:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390306.771506:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e4e32f6 going to sleep for 11 seconds 00000100:00100000:1.0:1788390306.771518:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097935232 00000100:00100000:1.0:1788390306.771522:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097935232 00000100:00100000:1.0:1788390306.771547:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390306.771553:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082a9894a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+11:7422:x1875263097935232:12345-0@lo:101: 00010000:00010000:1.0:1788390306.771560:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390306.771566:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b8a6329/0xe156d0713be971ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be971e6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771579:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b8a6329/0xe156d0713be971ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be971e6 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771585:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b8a6329/0xe156d0713be971ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be971e6 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771591:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b8a6329, rc 0) 00000100:00100000:1.0:1788390306.771616:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082a9894a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097935232:12345-0@lo:101: Request processed in 64us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390306.771621:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390306.771653:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935232:0@lo:101: 00010000:00010000:1.0:1788390306.771667:0:7422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 00000000e111b455/0xe156d0713be971e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771674:0:7422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 00000000e111b455/0xe156d0713be971e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390306.771682:0:7422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788390306.771685:0:7422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 00000000e111b455/0xe156d0713be971e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771691:0:7422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 00000000e111b455/0xe156d0713be971e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390306.771696:0:7422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788390306.771699:0:7422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390306.771702:0:7422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff984fb76a1000 10000000:01000000:1.0:1788390306.771704:0:7422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788390306.771707:0:7422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788390306.771708:0:7422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788390306.771719:0:7422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 00000000706efdfc/0xe156d0713be971f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771725:0:7422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 00000000706efdfc/0xe156d0713be971f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771731:0:7422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 00000000706efdfc/0xe156d0713be971f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390306.771740:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935360:0@lo:101: 00000100:00100000:1.0:1788390306.771763:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390306.771782:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e4e32f6 going to sleep for 11 seconds 00000100:00100000:1.0:1788390306.771794:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097935360 00000100:00100000:1.0:1788390306.771797:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097935360 00000100:00100000:1.0:1788390306.771926:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390306.771934:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037b21fc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097935360:12345-0@lo:101: 00010000:00010000:1.0:1788390306.771941:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390306.771947:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007509341f/0xe156d0713be971fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be971f4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771958:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007509341f/0xe156d0713be971fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be971f4 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771965:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007509341f/0xe156d0713be971fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be971f4 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.771971:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007509341f, rc 0) 00000100:00100000:1.0:1788390306.771999:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037b21fc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+13:7422:x1875263097935360:12345-0@lo:101: Request processed in 66us (235us total) trans 0 rc 0/0 00010000:00010000:2.0:1788390306.772044:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390306.772049:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.772056:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cf6fd384 already unused, calling callback (00000000cea255f4) 10000000:00010000:2.0:1788390306.772059:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.772067:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390306.772073:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390306.772079:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390306.772096:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.772103:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390306.772116:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.772122:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: 00000000cf6fd384/0xe156d0713be971ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe156d0713be971d1 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.772132:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390306.772134:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390306.772135:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390306.772144:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002cdf2dcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097935488:0@lo:103: 00000100:00100000:2.0:1788390306.772169:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390306.772200:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097935488 00000100:00100000:2.0:1788390306.772209:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097935488 00000100:00100000:2.0:1788390306.772236:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390306.772241:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049f383d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:3624:x1875263097935488:12345-0@lo:103: 00010000:00010000:2.0:1788390306.772248:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390306.772258:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006814e59b/0xe156d0713be971d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be971ca expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.772267:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390306.772291:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049f383d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+13:3624:x1875263097935488:12345-0@lo:103: Request processed in 50us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.772297:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390306.772348:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002cdf2dcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097935488:0@lo:103: 00000100:00100000:1.0:1788390306.775771:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390306.775896:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935360:0@lo:101: 00010000:00010000:1.0:1788390306.775918:0:7422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 00000000706efdfc/0xe156d0713be971f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390306.775930:0:7422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 00000000706efdfc/0xe156d0713be971f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390306.776028:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935616:0@lo:501: 00000100:00100000:1.0:1788390306.776075:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390306.776140:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e4e32f6 going to sleep for 11 seconds 00000100:00100000:2.0:1788390306.777965:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097935616 00000100:00100000:2.0:1788390306.777977:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097935616 00000100:00100000:2.0:1788390306.778433:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788390306.778442:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015032c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097935616:12345-0@lo:501: 00000100:00100000:2.0:1788390306.778600:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015032c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097935616:12345-0@lo:501: Request processed in 158us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.778608:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788390306.778715:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935616:0@lo:501: 00000100:00100000:1.0:1788390306.778752:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935744:0@lo:503: 00000100:00100000:1.0:1788390306.778796:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390306.778838:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e4e32f6 going to sleep for 11 seconds 00000100:00100000:2.0:1788390306.778928:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097935744 00000100:00100000:2.0:1788390306.778933:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097935744 00000100:00100000:2.0:1788390306.778964:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788390306.778970:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071897239 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097935744:12345-0@lo:503: 00000100:00100000:2.0:1788390306.779053:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071897239 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097935744:12345-0@lo:503: Request processed in 82us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.779059:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788390306.779156:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935744:0@lo:503: 00000040:00080000:1.0:1788390306.779452:0:7422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788390306.779516:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935872:0@lo:502: 00000100:00100000:1.0:1788390306.779550:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390306.779572:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e4e32f6 going to sleep for 11 seconds 00000100:00100000:0.0:1788390306.779623:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097935872 00000100:00100000:0.0:1788390306.779628:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097935872 00000100:00100000:0.0:1788390306.779657:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788390306.779663:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000556a7ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097935872:12345-0@lo:502: 00000100:00100000:0.0:1788390306.779742:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000556a7ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097935872:12345-0@lo:502: Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390306.779749:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788390306.779883:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097935872:0@lo:502: 00000040:00080000:1.0:1788390306.780084:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788390306.780107:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788390306.780120:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788390306.780133:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788390306.780145:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788390306.780170:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788390306.780183:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788390306.780196:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788390306.780208:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788390306.780220:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788390306.780231:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788390306.780245:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788390306.780257:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788390306.780270:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788390306.780280:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788390306.780291:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788390306.780304:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788390306.780924:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788390306.780949:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788390306.780975:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788390306.780989:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788390306.781014:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788390306.781029:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788390306.781056:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936000:0@lo:502: 00000100:00100000:1.0:1788390306.781106:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390306.781186:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e4e32f6 going to sleep for 11 seconds 00000100:00100000:0.0:1788390306.783513:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097936000 00000100:00100000:0.0:1788390306.783526:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097936000 00000100:00100000:0.0:1788390306.783594:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788390306.783603:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a279657 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097936000:12345-0@lo:502: 00000100:00100000:0.0:1788390306.783752:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a279657 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097936000:12345-0@lo:502: Request processed in 150us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390306.783760:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788390306.783941:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b32dff5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936000:0@lo:502: 00000040:00080000:3.0:1788390306.784020:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788390306.784032:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788390306.787716:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390306.787731:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390306.787734:0:7434:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788390306.787741:0:7434:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788390306.787745:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788390306.787760:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000077d63db1) 00000020:00000080:1.0:1788390306.787781:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788390306.787790:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788390306.787971:0:7434:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788390306.787979:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be97209 00000020:00000080:1.0:1788390306.788202:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788390306.788207:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390306.788211:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390306.788213:0:7434:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788390306.788215:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390306.788219:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390306.788220:0:7434:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788390306.788224:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788390306.788231:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000010822b2e) 00000020:00000080:1.0:1788390306.788242:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788390306.788247:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788390306.788249:0:7434:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788390306.788251:0:7434:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788390306.788257:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788390306.788302:0:7434:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000071e8e9eb from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788390306.789047:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000d62438b6) 00000020:00000080:1.0:1788390306.789059:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788390306.789123:0:7434:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788390306.789127:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be9721e 00000020:00000080:1.0:1788390306.789224:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788390306.789230:0:7434:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788390306.789233:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe156d0713be97225 00080000:01000000:1.0:1788390306.789239:0:7434:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788390306.789241:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be9722c 00080000:10000000:1.0:1788390306.790705:0:7434:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788390306.794807:0:7434:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788390306.950589:0:7434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788390306.951457:0:7434:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788390306.956553:0:7434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788390306.957633:0:7434:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:2.0:1788390306.969988:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788390306.982169:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788390306.982184:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390306.982190:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390306.982193:0:7434:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788390306.982196:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390306.982201:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390306.982202:0:7434:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788390306.982205:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788390306.982210:0:7434:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:00000080:0.0:1788390306.982237:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788390306.982259:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000006b893be5) 00000020:00000080:0.0:1788390306.982281:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788390306.982288:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788390306.983798:0:7434:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788390306.984401:0:7434:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788390306.984421:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be9723a 00010000:00080000:0.0:1788390306.984462:0:7434:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000465b2d94@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.111@tcp at head 00010000:00010000:0.0:1788390306.991531:0:7434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788390306.992493:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788390306.992507:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788390306.992542:0:7434:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788390306.992564:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be97241 00000100:00080000:0.0:1788390306.992576:0:7434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390306.992581:0:7434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000465b2d94 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390306.992618:0:7434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000003c7aeef x1875263097936128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788390306.992678:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003c7aeef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263097936128:0@lo:38: 00000100:00100000:3.0:1788390306.992749:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390306.993399:0:7434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788390306.993448:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390306.993452:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390306.993454:0:7434:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788390306.993457:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788390306.993460:0:7434:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788390306.993462:0:7434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788390306.993463:0:7434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788390306.993464:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788390306.993467:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390306.993469:0:7434:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788390306.993471:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390306.993476:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390306.993478:0:7434:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788390306.993482:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788390306.993512:0:7434:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788390306.993523:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390306.993526:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390306.993527:0:7434:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788390306.993530:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390306.993539:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390306.993540:0:7434:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390306.993543:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390306.993545:0:7434:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788390306.993574:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390306.993578:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390306.993579:0:7434:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788390306.993582:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1788390306.993710:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097936128 00000100:00100000:0.0:1788390306.993717:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097936128 00000100:00100000:0.0:1788390306.993744:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390306.993750:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012fea21a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1875263097936128:12345-0@lo:38: 00010000:00080000:0.0:1788390306.993770:0:6497:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 127 last 0 00000020:00000080:0.0:1788390306.993795:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be97248 00000100:00100000:2.0:1788390306.993969:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a00becb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097936256:0@lo:400: 00000100:00100000:2.0:1788390306.994007:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390306.994047:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097936256 00000100:00100000:2.0:1788390306.994050:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097936256 00000100:00100000:2.0:1788390306.994080:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390306.994086:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cdf2dcf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097936256:12345-0@lo:400: 00000100:00100000:2.0:1788390306.994129:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cdf2dcf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097936256:12345-0@lo:400: Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390306.994136:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788390306.994171:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002a00becb x1875263097936256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390306.994183:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a00becb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097936256:0@lo:400: 00000020:01000000:2.0:1788390306.994211:0:7422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788390306.994239:0:7422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788390306.994253:0:7422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 00000000706efdfc/0xe156d0713be971f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.994263:0:7422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 00000000706efdfc/0xe156d0713be971f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390306.994270:0:7422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984fb76a1000 from 1 10000000:01000000:2.0:1788390306.994272:0:7422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788390306.994292:0:7422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.994299:0:7422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:0.0:1788390306.996458:0:6497:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788390306.996468:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788390306.996643:0:7422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390306.996668:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936384:0@lo:101: 00000100:00100000:2.0:1788390306.996726:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390306.996973:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f529715a going to sleep for 11 seconds 00000100:00100000:0.0:1788390306.997390:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097936384 00000100:00100000:0.0:1788390306.997399:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097936384 00000100:00100000:0.0:1788390306.997438:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788390306.997445:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062e3183b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+12:7422:x1875263097936384:12345-0@lo:101: 00010000:00010000:0.0:1788390306.997459:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390306.997474:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9724f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390306.997499:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9724f expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390306.997511:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9724f expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390306.997537:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e5fa0e12, rc 0) 00000100:00100000:0.0:1788390306.997584:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062e3183b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+13:7422:x1875263097936384:12345-0@lo:101: Request processed in 140us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390306.997591:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788390306.998411:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936384:0@lo:101: 00010000:00010000:2.0:1788390306.998429:0:7422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390306.998439:0:7422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390306.999092:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936512:0@lo:256: 00000100:00100000:2.0:1788390306.999145:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390306.999228:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f529715a going to sleep for 11 seconds 00000100:00100000:1.0:1788390307.001731:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097936512 00000100:00100000:1.0:1788390307.001745:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097936512 00000100:00100000:1.0:1788390307.001786:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788390307.001793:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9463e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+13:7422:x1875263097936512:12345-0@lo:256: 20000000:01000000:1.0:1788390307.003890:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788390307.003916:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788390307.003919:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788390307.004055:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9463e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+13:7422:x1875263097936512:12345-0@lo:256: Request processed in 2260us (4908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390307.004065:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788390307.004176:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936512:0@lo:256: 10000000:01000000:3.0:1788390307.004732:0:7422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390307.004753:0:7422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390307.005306:0:7422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390307.005341:0:7422:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fb76a1000 from 1 10000000:01000000:3.0:1788390307.005343:0:7422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390307.005378:0:7422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390307.005384:0:7422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390307.005392:0:7422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390307.005410:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000976e0434 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936640:0@lo:101: 00000100:00100000:3.0:1788390307.005464:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390307.005513:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf8f0621 going to sleep for 11 seconds 00000100:00100000:1.0:1788390307.005673:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097936640 00000100:00100000:1.0:1788390307.005681:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097936640 00000100:00100000:1.0:1788390307.005733:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788390307.005741:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007348fff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+13:7422:x1875263097936640:12345-0@lo:101: 00010000:00010000:1.0:1788390307.005753:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390307.005765:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9725d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390307.005786:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9725d expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390307.005816:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9725d expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390307.005825:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2c88e7d, rc 0) 00000100:00100000:1.0:1788390307.005857:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007348fff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+14:7422:x1875263097936640:12345-0@lo:101: Request processed in 117us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390307.005863:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788390307.006375:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000976e0434 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936640:0@lo:101: 00010000:00010000:3.0:1788390307.006387:0:7422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390307.006395:0:7422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390307.006493:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000976e0434 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936768:0@lo:501: 00000100:00100000:3.0:1788390307.006521:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390307.006551:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf8f0621 going to sleep for 11 seconds 00000100:00100000:1.0:1788390307.006768:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097936768 00000100:00100000:1.0:1788390307.006773:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097936768 00000100:00100000:1.0:1788390307.006820:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788390307.006828:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff82e918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:7422:x1875263097936768:12345-0@lo:501: 00000100:00100000:1.0:1788390307.006925:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff82e918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:7422:x1875263097936768:12345-0@lo:501: Request processed in 98us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390307.006931:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788390307.006963:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000976e0434 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936768:0@lo:501: 00000100:00100000:1.0:1788390307.006990:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f3e4f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936896:0@lo:503: 00000100:00100000:1.0:1788390307.007028:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390307.007042:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074ad536d going to sleep for 11 seconds 00000100:00100000:1.0:1788390307.007055:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097936896 00000100:00100000:1.0:1788390307.007059:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097936896 00000100:00100000:1.0:1788390307.007080:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788390307.007086:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052b07108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+14:7422:x1875263097936896:12345-0@lo:503: 00000040:00080000:1.0:1788390307.007118:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788390307.007154:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052b07108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+14:7422:x1875263097936896:12345-0@lo:503: Request processed in 68us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390307.007161:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788390307.007207:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f3e4f9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097936896:0@lo:503: 00000040:00080000:1.0:1788390307.007556:0:7422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390307.007602:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788390307.007670:0:7422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390307.010516:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788390307.011385:0:7422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788390307.011418:0:7422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390307.011436:0:7422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390307.011449:0:7422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390307.011506:0:7422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788390307.011509:0:7422:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984fb76a1000 10000000:01000000:3.0:1788390307.011513:0:7422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984fb76a1000 10000000:01000000:3.0:1788390307.011517:0:7422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390307.011522:0:7422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fb76a1000 from 1 10000000:01000000:3.0:1788390307.011525:0:7422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390307.011558:0:7422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 00000000ac41502c/0xe156d0713be9726b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390307.011566:0:7422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 00000000ac41502c/0xe156d0713be9726b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390307.011576:0:7422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 00000000ac41502c/0xe156d0713be9726b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390307.011597:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937024:0@lo:101: 00000100:00100000:3.0:1788390307.011665:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390307.011699:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e44221a going to sleep for 11 seconds 00000100:00100000:1.0:1788390307.012376:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097937024 00000100:00100000:1.0:1788390307.012385:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097937024 00000100:00100000:1.0:1788390307.012437:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788390307.012445:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a870bce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+14:7422:x1875263097937024:12345-0@lo:101: 00010000:00010000:1.0:1788390307.012459:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390307.012470:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c6084cb/0xe156d0713be97272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9726b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390307.012491:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c6084cb/0xe156d0713be97272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9726b expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390307.012501:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c6084cb/0xe156d0713be97272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9726b expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390307.012510:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c6084cb, rc 0) 00000100:00100000:1.0:1788390307.012550:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a870bce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937024:12345-0@lo:101: Request processed in 106us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390307.012556:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390307.012661:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937024:0@lo:101: 00010000:00010000:3.0:1788390307.012674:0:7422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 00000000ac41502c/0xe156d0713be9726b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390307.012700:0:7422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 00000000ac41502c/0xe156d0713be9726b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390307.012785:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937152:0@lo:501: 00000100:00100000:3.0:1788390307.012886:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390307.012919:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e44221a going to sleep for 11 seconds 00000100:00100000:2.0:1788390307.013000:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097937152 00000100:00100000:2.0:1788390307.013005:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097937152 00000100:00100000:2.0:1788390307.013031:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390307.013037:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fc04a2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937152:12345-0@lo:501: 00000100:00100000:2.0:1788390307.013130:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fc04a2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937152:12345-0@lo:501: Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.013136:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390307.013167:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d23a094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937152:0@lo:501: 00000100:00100000:2.0:1788390307.013192:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937280:0@lo:503: 00000100:00100000:2.0:1788390307.013235:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390307.013248:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f529715a going to sleep for 11 seconds 00000100:00100000:2.0:1788390307.013260:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097937280 00000100:00100000:2.0:1788390307.013264:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097937280 00000100:00100000:2.0:1788390307.013281:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788390307.013286:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d7c9150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937280:12345-0@lo:503: 00000100:00100000:2.0:1788390307.013404:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d7c9150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937280:12345-0@lo:503: Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.013411:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788390307.013460:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937280:0@lo:503: 00000040:00080000:2.0:1788390307.013741:0:7422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390307.013800:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937408:0@lo:502: 00000100:00100000:2.0:1788390307.014446:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390307.014579:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc23f5e1 going to sleep for 11 seconds 00000100:00080000:0.0:1788390307.015711:0:6497:0:(import.c:65:import_set_state_nolock()) 00000000a50eaf22 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390307.015796:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012fea21a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1875263097936128:12345-0@lo:38: Request processed in 22043us (23046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390307.015805:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390307.015964:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788390307.015973:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788390307.015980:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788390307.015985:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788390307.015987:0:3621:0:(import.c:65:import_set_state_nolock()) 00000000465b2d94 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788390307.016008:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003c7aeef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263097936128:0@lo:38: 00000100:00100000:2.0:1788390307.016995:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4b45ed8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097937536:0@lo:41: 00000100:00100000:2.0:1788390307.017041:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390307.017395:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097937536 00000100:00100000:0.0:1788390307.017401:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097937536 00000100:00100000:0.0:1788390307.017451:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390307.017459:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f4db0a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875263097937536:12345-0@lo:41: 00000004:00000024:0.0:1788390307.017487:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788390307.017532:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f4db0a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875263097937536:12345-0@lo:41: Request processed in 74us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390307.017538:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390307.017606:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4b45ed8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097937536:0@lo:41: 00000100:00100000:3.0:1788390307.018437:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097937408 00000100:00100000:3.0:1788390307.018443:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097937408 00000100:00100000:2.0:1788390307.021015:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390307.021028:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000296d9902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937408:12345-0@lo:502: 00000100:00100000:2.0:1788390307.021212:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000296d9902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937408:12345-0@lo:502: Request processed in 187us (6768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.021220:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788390307.021312:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937408:0@lo:502: 00000040:00080000:0.0:1788390307.021606:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788390307.021637:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788390307.021652:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788390307.021667:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788390307.021680:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788390307.021693:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788390307.021707:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788390307.021721:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788390307.021734:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788390307.021747:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788390307.021772:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788390307.021786:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788390307.021799:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788390307.021827:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788390307.021843:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788390307.021857:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788390307.021870:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788390307.021886:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788390307.021900:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788390307.021914:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788390307.021929:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788390307.021942:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788390307.021957:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788390307.021970:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788390307.021985:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788390307.021998:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788390307.022012:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788390307.022026:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788390307.022060:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a086c949 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937664:0@lo:502: 00000100:00100000:0.0:1788390307.022109:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390307.035594:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032772d79 going to sleep for 11 seconds 00000100:00100000:2.0:1788390307.041950:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097937664 00000100:00100000:2.0:1788390307.041967:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097937664 00000100:00100000:2.0:1788390307.042022:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788390307.042032:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a0e0d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937664:12345-0@lo:502: 00000100:00100000:2.0:1788390307.042217:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a0e0d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937664:12345-0@lo:502: Request processed in 186us (20107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.042225:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788390307.042372:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a086c949 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937664:0@lo:502: 00000040:00080000:0.0:1788390307.042457:0:7422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788390307.042472:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788390307.043647:0:7440:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788390307.043673:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000d0768089) 00000020:00000080:2.0:1788390307.043693:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788390307.043805:0:7440:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000071e8e9eb from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788390307.043873:0:7440:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000071e8e9eb from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788390307.043876:0:7440:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000071e8e9eb 3 00010000:00080000:2.0:1788390307.043901:0:7440:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003c114b3d@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.111@tcp at head 00010000:00010000:2.0:1788390307.046271:0:7440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788390307.048578:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788390307.048622:0:7440:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788390307.048637:0:7440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe156d0713be97280 00000100:00080000:2.0:1788390307.048647:0:7440:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390307.048652:0:7440:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000003c114b3d using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390307.048688:0:7440:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000071d57163 x1875263097937792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390307.048757:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071d57163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875263097937792:0@lo:38: 00000100:00100000:1.0:1788390307.048898:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788390307.048957:0:7440:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788390307.051950:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097937792 00000100:00100000:0.0:1788390307.051962:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097937792 00000100:00100000:0.0:1788390307.052004:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390307.052011:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f3e4f9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875263097937792:12345-0@lo:38: 00010000:00080000:0.0:1788390307.052037:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 127 last 0 00000020:00000080:0.0:1788390307.052071:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe156d0713be97287 00000004:00100000:0.0:1788390307.052093:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788390307.052120:0:6492:0:(import.c:65:import_set_state_nolock()) 00000000db1c49b4 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788390307.054013:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1788390307.055952:0:7441:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1788390307.057467:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f3e4f9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875263097937792:12345-0@lo:38: Request processed in 5447us (8562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390307.057481:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1788390307.057545:0:7422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788390307.057579:0:7422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788390307.057599:0:7422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 00000000ac41502c/0xe156d0713be9726b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390307.057610:0:7422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 00000000ac41502c/0xe156d0713be9726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788390307.057658:0:7422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788390307.057660:0:7422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788390307.057662:0:7422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390307.057663:0:7422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390307.057664:0:7422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390307.057665:0:7422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390307.057667:0:7422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390307.057668:0:7422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788390307.057670:0:7422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788390307.057671:0:7422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390307.057673:0:7422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390307.057676:0:7422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788390307.057679:0:7422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390307.057680:0:7422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788390307.057681:0:7422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390307.057682:0:7422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390307.057683:0:7422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390307.057684:0:7422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390307.057685:0:7422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390307.057686:0:7422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788390307.057687:0:7422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788390307.057688:0:7422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390307.057693:0:7422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390307.057717:0:7422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788390307.057730:0:7422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a086c949 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937920:0@lo:253: 00000100:00100000:0.0:1788390307.057789:0:7422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390307.057909:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097937920 00000100:00100000:2.0:1788390307.057916:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097937920 00000100:00100000:2.0:1788390307.057952:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788390307.057960:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ef0d5d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7422:x1875263097937920:12345-0@lo:253: 20000000:01000000:2.0:1788390307.057982:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788390307.057995:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788390307.059065:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788390307.059091:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788390307.059099:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788390307.061135:0:7422:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032772d79 going to sleep for 11 seconds 20000000:01000000:2.0:1788390307.062845:0:6508:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788390307.062852:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788390307.062871:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.062888:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be971a7 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.062895:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9724f expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.062902:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.062947:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9724f expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.062959:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9724f expref: 15 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390307.062974:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097938048:0@lo:104: 00000100:00100000:2.0:1788390307.063033:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390307.063079:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be971a7 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063087:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be971a7 expref: 15 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390307.063094:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb2ba791 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097938176:0@lo:104: 00000100:00100000:2.0:1788390307.063113:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390307.063127:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f25fd7db going to sleep for 11 seconds 00000100:00100000:2.0:1788390307.063149:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097938048 00000100:00100000:2.0:1788390307.063155:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097938048 00000100:00100000:2.0:1788390307.063187:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097938176 00000100:00100000:2.0:1788390307.063189:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097938176 00000100:00100000:2.0:1788390307.063201:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390307.063208:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b9f56b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6508:x1875263097938048:12345-0@lo:104: 00010000:00010000:2.0:1788390307.063218:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063262:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390307.063267:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b9f56b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6508:x1875263097938048:12345-0@lo:104: Request processed in 60us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.063274:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390307.063289:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390307.063294:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b4581a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6508:x1875263097938176:12345-0@lo:104: 00010000:00010000:2.0:1788390307.063299:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063358:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788390307.063363:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b4581a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6508:x1875263097938176:12345-0@lo:104: Request processed in 70us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.063373:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390307.063402:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097938048:0@lo:104: 00000100:00100000:2.0:1788390307.063410:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb2ba791 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097938176:0@lo:104: 00010000:00010000:2.0:1788390307.063426:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063442:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390307.063447:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063453:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006814e59b already unused, calling callback (00000000cea255f4) 10000000:00010000:2.0:1788390307.063456:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063463:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390307.063469:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390307.063475:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390307.063499:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063505:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390307.063521:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063527:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: 000000006814e59b/0xe156d0713be9724f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97256 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063543:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390307.063546:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063550:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f154db6 already unused, calling callback (00000000cea255f4) 10000000:00010000:2.0:1788390307.063552:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063558:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390307.063563:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390307.063568:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390307.063580:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063585:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390307.063597:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063601:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: 000000005f154db6/0xe156d0713be971a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be971ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063612:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390307.063614:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390307.063615:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390307.063620:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390307.063635:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb2ba791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097938304:0@lo:103: 00000100:00100000:2.0:1788390307.063661:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390307.063693:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097938432:0@lo:103: 00000100:00100000:2.0:1788390307.063715:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390307.063741:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097938304 00000100:00100000:2.0:1788390307.063745:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097938304 00010000:00010000:2.0:1788390307.063759:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9724f expref: 16 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390307.063774:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097938432 00000100:00100000:2.0:1788390307.063777:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097938432 00010000:00010000:2.0:1788390307.063784:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be971a7 expref: 17 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390307.063795:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390307.063800:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000823681b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:3623:x1875263097938304:12345-0@lo:103: 00010000:00010000:2.0:1788390307.063809:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390307.063812:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9724f expref: 17 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063821:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9724f expref: 17 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063831:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e5fa0e12/0xe156d0713be97256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9724f expref: 17 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063841:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390307.063864:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000823681b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:3623:x1875263097938304:12345-0@lo:103: Request processed in 64us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.063870:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390307.063888:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390307.063893:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093235ef5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3624:x1875263097938432:12345-0@lo:103: 00010000:00010000:2.0:1788390307.063900:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390307.063903:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be971a7 expref: 15 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063911:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be971a7 expref: 15 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063919:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009526ea3e/0xe156d0713be971ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be971a7 expref: 15 pid: 6484 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063928:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063934:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788390307.063944:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001178984s 00010000:00010000:2.0:1788390307.063948:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063953:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063958:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063964:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063968:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e134b78c already unused, calling callback (00000000a949f04c) 00010000:00010000:2.0:1788390307.063977:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063983:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.063993:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.064002:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390307.064025:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093235ef5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:3624:x1875263097938432:12345-0@lo:103: Request processed in 132us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.064031:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390307.064075:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb2ba791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097938304:0@lo:103: 00010000:00010000:2.0:1788390307.064088:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.064094:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390307.064099:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e134b78c/0xe156d0713be9728e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390307.064117:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097938432:0@lo:103: 00000100:00100000:3.0:1788390307.065459:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ef0d5d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+13:7422:x1875263097937920:12345-0@lo:253: Request processed in 7495us (7666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390307.065469:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788390307.065601:0:7422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a086c949 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:7422:1875263097937920:0@lo:253: 10000000:01000000:2.0:1788390307.065613:0:7422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788390307.065616:0:7422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788390307.065618:0:7422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788390307.065619:0:7422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390307.065620:0:7422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390307.065632:0:7422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390307.065634:0:7422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390307.065635:0:7422:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788390307.065637:0:7422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390307.065638:0:7422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390307.065639:0:7422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390307.065640:0:7422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788390307.065651:0:7422:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00080000:1.0:1788390307.066986:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000071d57163 x1875263097937792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390307.066998:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390307.067007:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788390307.067025:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788390307.067029:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788390307.067033:0:3621:0:(import.c:65:import_set_state_nolock()) 000000003c114b3d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788390307.067039:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071d57163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875263097937792:0@lo:38: 00080000:10000000:3.0:1788390307.080978:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788390307.081181:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788390307.082043:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788390307.082210:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788390307.083035:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788390307.083204:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788390307.084937:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788390307.085146:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788390307.086449:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788390307.086657:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788390307.086910:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788390307.087090:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788390307.090922:0:7422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788390307.090990:0:7445:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788390307.090994:0:7445:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788390307.091213:0:7446:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788390307.091265:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7446:1875263097938560:0@lo:700: 00000100:00100000:3.0:1788390307.091365:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390307.091406:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4c48717 going to sleep for 11 seconds 00000100:00100000:2.0:1788390307.091470:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097938560 00000100:00100000:2.0:1788390307.091478:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097938560 00000100:00100000:2.0:1788390307.091531:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390307.091541:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065affb70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7446:x1875263097938560:12345-0@lo:700: 00000040:01000000:0.0:1788390307.091712:0:7422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788390307.092097:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8bdac3d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097938688:0@lo:1000: 00000100:00100000:3.0:1788390307.092132:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390307.092159:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000002cdb77a0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390307.092206:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097938688 00000100:00100000:2.0:1788390307.092210:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097938688 00000100:00100000:2.0:1788390307.092249:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390307.092256:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042112760 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097938688:12345-0@lo:1000: 00000100:00100000:2.0:1788390307.092354:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042112760 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097938688:12345-0@lo:1000: Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.092362:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390307.092403:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8bdac3d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097938688:0@lo:1000: 00000040:01000000:2.0:1788390307.092430:0:7447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788390307.092450:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097938816:0@lo:700: 00000100:00100000:2.0:1788390307.092475:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390307.092488:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 00000000905c5dbe going to sleep for 11 seconds 00000100:00100000:0.0:1788390307.092581:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097938816 00000100:00100000:0.0:1788390307.092586:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097938816 00000100:00100000:0.0:1788390307.092620:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390307.092627:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb2ba791 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097938816:12345-0@lo:700: 00000100:00100000:0.0:1788390307.092676:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb2ba791 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097938816:12345-0@lo:700: Request processed in 50us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390307.092683:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390307.092906:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097938816:0@lo:700: 00000100:00100000:3.0:1788390307.092955:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ab2951d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7447:1875263097938944:0@lo:900: 00000100:00100000:3.0:1788390307.092980:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390307.093008:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000002c2559ca going to sleep for 11 seconds 00000100:00100000:0.0:1788390307.093365:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097938944 00000100:00100000:0.0:1788390307.093370:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097938944 00000100:00100000:0.0:1788390307.093397:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390307.093403:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000697984a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7447:x1875263097938944:12345-0@lo:900: 00000100:00100000:0.0:1788390307.094509:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000697984a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7447:x1875263097938944:12345-0@lo:900: Request processed in 1103us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390307.094519:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788390307.094863:0:7422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788390307.094987:0:7422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788390307.096070:0:7422:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788390307.096082:0:7422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788390307.096236:0:7422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:2.0:1788390307.097801:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:0.0:1788390307.099928:0:7422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:3.0:1788390307.103429:0:7447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007ab2951d x1875263097938944/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788390323 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390307.103448:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ab2951d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7447:1875263097938944:0@lo:900: 00000040:00080000:0.0:1788390307.103759:0:7422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788390307.103960:0:7422:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788390307.104199:0:7422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390307.105465:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ab2951d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097939072:0@lo:1000: 00000100:00100000:3.0:1788390307.105530:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390307.105564:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003d5abf1 going to sleep for 11 seconds 00080000:10000000:0.0:1788390307.105754:0:7422:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788390307.108106:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788390307.108251:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788390307.108942:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788390307.109088:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788390307.109268:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788390307.109707:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788390307.109835:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788390307.109950:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788390307.110084:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788390307.110197:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788390307.110309:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788390307.110518:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788390307.110650:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788390307.110764:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000100:00100000:2.0:1788390307.110924:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097939072 00000100:00100000:2.0:1788390307.110932:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097939072 00000100:00100000:2.0:1788390307.110980:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390307.110988:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000571bd6a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097939072:12345-0@lo:1000: 00000100:00100000:2.0:1788390307.111092:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000571bd6a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097939072:12345-0@lo:1000: Request processed in 104us (5563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.111106:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390307.111144:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065affb70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7446:x1875263097938560:12345-0@lo:700: Request processed in 19606us (19781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.111152:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390307.111193:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ab2951d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097939072:0@lo:1000: 00000004:00080000:2.0:1788390307.111247:0:7447:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002c2559ca with version 0 00000020:00100000:2.0:1788390307.111266:0:7447:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788390307.111272:0:7447:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006b6d579c x1875263097939328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390307.111290:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b6d579c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097939328:0@lo:1000: 00100000:10000000:1.0:1788390307.111559:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788390307.111676:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788390307.112056:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788390307.112182:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788390307.112300:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788390307.112582:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788390307.112703:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788390307.112843:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788390307.112981:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788390307.113126:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788390307.113262:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788390307.113605:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788390307.113762:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788390307.113932:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788390307.114072:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788390307.114208:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788390307.114374:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788390307.114532:0:7422:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788390307.114722:0:7422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:3.0:1788390307.115717:0:7446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006f336daa x1875263097938560/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788390323 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390307.115734:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7446:1875263097938560:0@lo:700: 40000000:02000000:3.0:1788390307.115746:0:7446:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:2.0:1788390307.117908:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390307.118094:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091376cf4 going to sleep for 11 seconds 00000100:00100000:0.0:1788390307.118143:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097939328 00000100:00100000:0.0:1788390307.118152:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097939328 00000100:00100000:0.0:1788390307.118237:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390307.118245:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a863addd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097939328:12345-0@lo:1000: 00000001:00080000:0.0:1788390307.118630:0:7422:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788390307.118660:0:7422:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4a7c1cc3988 00100000:10000000:0.0:1788390307.118668:0:7422:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788390307.118982:0:7422:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788390307.119015:0:7422:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788390307.119038:0:7422:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788390307.119051:0:7422:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788390307.128903:0:7422:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390307.129054:0:7422:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:3.0:1788390307.138424:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1788390307.138817:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a863addd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097939328:12345-0@lo:1000: Request processed in 20568us (20908us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788390307.138830:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788390307.139428:0:7447:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788390307.139434:0:7447:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788390307.139449:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b6d579c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097939328:0@lo:1000: 00000100:00100000:3.0:1788390307.139531:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097939456:0@lo:1000: 00000100:00100000:3.0:1788390307.139569:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390307.139604:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000005bedbc8d going to sleep for 11 seconds 00000100:00100000:2.0:1788390307.140676:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097939456 00000100:00100000:2.0:1788390307.140686:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097939456 00000100:00100000:2.0:1788390307.140879:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390307.140888:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048a895f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097939456:12345-0@lo:1000: 00000100:00100000:2.0:1788390307.140970:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048a895f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7447:x1875263097939456:12345-0@lo:1000: Request processed in 83us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390307.140977:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390307.142300:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7447:1875263097939456:0@lo:1000: 00000040:00080000:3.0:1788390307.142357:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788390307.142393:0:7447:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002c2559ca with version 1 00000004:00080000:2.0:1788390307.142515:0:7437:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000005b726f5e version 1 rpc_version 1 00000020:00100000:2.0:1788390307.142536:0:7437:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788390307.142542:0:7437:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000a136c18 x1875263097939712/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390307.142559:0:7437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a136c18 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7437:1875263097939712:0@lo:1000: 00000100:00100000:2.0:1788390307.142600:0:7437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390307.142631:0:7437:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f529715a going to sleep for 11 seconds 00000100:00100000:2.0:1788390307.142643:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097939712 00000100:00100000:2.0:1788390307.142647:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097939712 00000100:00100000:2.0:1788390307.142671:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390307.142676:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049f383d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7437:x1875263097939712:12345-0@lo:1000: 00000040:00080000:3.0:1788390307.144554:0:7447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788390307.144613:0:7447:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:3.0:1788390307.157528:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788390307.157993:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049f383d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7437:x1875263097939712:12345-0@lo:1000: Request processed in 15312us (15389us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788390307.158006:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788390307.158059:0:7437:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788390307.158063:0:7437:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788390307.158078:0:7437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a136c18 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7437:1875263097939712:0@lo:1000: 00000040:00080000:0.0:1788390307.161914:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390307.176089:0:7446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788390307.176154:0:7446:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788390307.176158:0:7446:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788390307.988915:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390309.010893:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788390309.074410:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390309.074418:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984fb76a1000 from 4 10000000:01000000:3.0:1788390309.074423:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390309.074487:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 00000000d00f5cdd/0xe156d0713be97295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.074500:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 00000000d00f5cdd/0xe156d0713be97295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.074511:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 00000000d00f5cdd/0xe156d0713be97295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390309.074534:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097939840:0@lo:101: 00000100:00100000:3.0:1788390309.074602:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.074667:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6caa096 going to sleep for 11 seconds 00000100:00100000:1.0:1788390309.075447:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097939840 00000100:00100000:1.0:1788390309.075456:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097939840 00000100:00100000:1.0:1788390309.075511:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788390309.075520:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc11cd4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+13:6489:x1875263097939840:12345-0@lo:101: 00010000:00010000:1.0:1788390309.075534:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390309.075547:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c216a32b/0xe156d0713be9729c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97295 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390309.075568:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c216a32b/0xe156d0713be9729c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97295 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390309.075576:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c216a32b/0xe156d0713be9729c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97295 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390309.075585:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c216a32b, rc 0) 00000100:00100000:1.0:1788390309.075623:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc11cd4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+14:6489:x1875263097939840:12345-0@lo:101: Request processed in 105us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390309.075629:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788390309.075737:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097939840:0@lo:101: 00010000:00010000:2.0:1788390309.075751:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 00000000d00f5cdd/0xe156d0713be97295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.075758:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 00000000d00f5cdd/0xe156d0713be97295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390309.075802:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000823681b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097939968:0@lo:256: 00000100:00100000:2.0:1788390309.075834:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390309.075864:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a52fce07 going to sleep for 11 seconds 00000100:00100000:3.0:1788390309.075884:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097939968 00000100:00100000:3.0:1788390309.075889:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097939968 00000100:00100000:1.0:1788390309.075923:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788390309.076239:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d11bdcba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+14:6489:x1875263097939968:12345-0@lo:256: 20000000:01000000:1.0:1788390309.076253:0:6487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788390309.076268:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788390309.076271:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788390309.076377:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d11bdcba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+14:6489:x1875263097939968:12345-0@lo:256: Request processed in 142us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.076440:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000823681b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097939968:0@lo:256: 10000000:01000000:2.0:1788390309.076490:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788390309.076497:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 00000000d00f5cdd/0xe156d0713be97295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.076504:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 00000000d00f5cdd/0xe156d0713be97295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390309.076513:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788390309.076520:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984f988e6800 from 21 10000000:01000000:2.0:1788390309.076523:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788390309.076539:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 0000000029cb1bdd/0xe156d0713be972a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.076546:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 0000000029cb1bdd/0xe156d0713be972a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.076554:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 0000000029cb1bdd/0xe156d0713be972a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390309.076565:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000823681b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940096:0@lo:101: 00000100:00100000:2.0:1788390309.076591:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390309.076610:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a52fce07 going to sleep for 11 seconds 00000100:00100000:2.0:1788390309.076622:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097940096 00000100:00100000:2.0:1788390309.076626:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097940096 00000100:00100000:1.0:1788390309.085550:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788390309.086472:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788390309.086490:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff8723d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+14:6489:x1875263097940096:12345-0@lo:101: 00010000:00010000:2.0:1788390309.086509:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390309.086527:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b284f67/0xe156d0713be972aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be972a3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.086554:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b284f67/0xe156d0713be972aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be972a3 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.086563:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b284f67/0xe156d0713be972aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972a3 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.086572:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b284f67, rc 0) 00000100:00100000:2.0:1788390309.086640:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff8723d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097940096:12345-0@lo:101: Request processed in 158us (10048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.086653:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788390309.090664:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000823681b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940096:0@lo:101: 00010000:00010000:3.0:1788390309.090691:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 0000000029cb1bdd/0xe156d0713be972a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.090715:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 0000000029cb1bdd/0xe156d0713be972a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390309.090892:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5d2494a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940224:0@lo:501: 00000100:00100000:3.0:1788390309.090947:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.090985:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e2cabfb going to sleep for 11 seconds 00000100:00100000:2.0:1788390309.091412:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097940224 00000100:00100000:2.0:1788390309.091420:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097940224 00000100:00100000:2.0:1788390309.092419:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788390309.092432:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000310a101e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097940224:12345-0@lo:501: 00000100:00100000:2.0:1788390309.092590:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000310a101e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097940224:12345-0@lo:501: Request processed in 162us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.092598:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390309.092687:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5d2494a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940224:0@lo:501: 00000100:00100000:1.0:1788390309.092725:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009783b2f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940352:0@lo:503: 00000100:00100000:1.0:1788390309.092769:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390309.099333:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad59a626 going to sleep for 11 seconds 00000100:00100000:3.0:1788390309.100888:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097940352 00000100:00100000:3.0:1788390309.100902:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097940352 00000100:00100000:3.0:1788390309.100954:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788390309.100962:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005556f184 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097940352:12345-0@lo:503: 00000100:00100000:3.0:1788390309.101106:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005556f184 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097940352:12345-0@lo:503: Request processed in 144us (8337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390309.101113:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788390309.103157:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009783b2f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940352:0@lo:503: 00000100:00100000:3.0:1788390309.104094:0:7521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:7521:1875263097940480:0@lo:502: 00000100:00100000:3.0:1788390309.104162:0:7521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.104203:0:7521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb0800df going to sleep for 11 seconds 00000100:00100000:1.0:1788390309.104427:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097940480 00000100:00100000:1.0:1788390309.104434:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097940480 00000100:00100000:1.0:1788390309.104537:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788390309.104545:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d13c2f9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7521:x1875263097940480:12345-0@lo:502: 00000100:00100000:1.0:1788390309.104659:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d13c2f9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7521:x1875263097940480:12345-0@lo:502: Request processed in 114us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390309.104667:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390309.105054:0:7521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:7521:1875263097940480:0@lo:502: 00000100:00100000:3.0:1788390309.105098:0:7521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:7521:1875263097940608:0@lo:502: 00000100:00100000:3.0:1788390309.105130:0:7521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.105155:0:7521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb0800df going to sleep for 11 seconds 00000100:00100000:0.0:1788390309.106432:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097940608 00000100:00100000:0.0:1788390309.106442:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097940608 00000100:00100000:0.0:1788390309.107535:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788390309.107545:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bdd8072 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7521:x1875263097940608:12345-0@lo:502: 00000100:00100000:0.0:1788390309.107713:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bdd8072 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:7521:x1875263097940608:12345-0@lo:502: Request processed in 170us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390309.107768:0:7521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:7521:1875263097940608:0@lo:502: 00000040:00080000:3.0:1788390309.107801:0:7521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788390309.108436:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788390309.108456:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390309.108465:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 0000000029cb1bdd/0xe156d0713be972a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390309.108476:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 0000000029cb1bdd/0xe156d0713be972a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390309.108498:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788390309.108500:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984f988e6800 from 4 10000000:01000000:1.0:1788390309.108503:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788390309.108530:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 000000009526ea3e/0xe156d0713be972b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390309.108538:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 000000009526ea3e/0xe156d0713be972b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390309.108546:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 000000009526ea3e/0xe156d0713be972b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390309.108562:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009783b2f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940736:0@lo:101: 00000100:00100000:1.0:1788390309.108599:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390309.108628:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000473aaba4 going to sleep for 11 seconds 00000100:00100000:3.0:1788390309.110478:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097940736 00000100:00100000:3.0:1788390309.110492:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097940736 00000100:00100000:0.0:1788390309.112429:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788390309.115596:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788390309.115631:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c950367f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097940736:12345-0@lo:101: 00010000:00010000:3.0:1788390309.115649:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390309.115666:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071a49f5b/0xe156d0713be972b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be972b1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.115692:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071a49f5b/0xe156d0713be972b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be972b1 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.115701:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071a49f5b/0xe156d0713be972b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972b1 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.115710:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071a49f5b, rc 0) 00000100:00100000:3.0:1788390309.115789:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c950367f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097940736:12345-0@lo:101: Request processed in 169us (7190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390309.115826:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009783b2f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940736:0@lo:101: 00010000:00010000:1.0:1788390309.115845:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 000000009526ea3e/0xe156d0713be972b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390309.115854:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 000000009526ea3e/0xe156d0713be972b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390309.115910:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009783b2f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940864:0@lo:256: 00000100:00100000:1.0:1788390309.115947:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390309.115977:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000473aaba4 going to sleep for 11 seconds 00000100:00100000:1.0:1788390309.115991:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097940864 00000100:00100000:1.0:1788390309.115996:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097940864 00000100:00100000:3.0:1788390309.121434:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788390309.127240:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788390309.127265:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e14e6df6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097940864:12345-0@lo:256: 20000000:01000000:1.0:1788390309.127897:0:6487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788390309.127913:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788390309.127916:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788390309.128036:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e14e6df6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097940864:12345-0@lo:256: Request processed in 775us (12088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390309.128045:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788390309.128370:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009783b2f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940864:0@lo:256: 10000000:01000000:0.0:1788390309.128420:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788390309.128429:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 000000009526ea3e/0xe156d0713be972b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390309.128439:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 000000009526ea3e/0xe156d0713be972b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390309.128448:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788390309.128450:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788390309.128453:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788390309.128493:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 0000000055016653/0xe156d0713be972bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390309.128500:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 0000000055016653/0xe156d0713be972bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390309.128509:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 0000000055016653/0xe156d0713be972bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390309.128525:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acdd2474 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940992:0@lo:101: 00000100:00100000:0.0:1788390309.128566:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390309.128590:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031cbf3cf going to sleep for 11 seconds 00000100:00100000:3.0:1788390309.128787:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097940992 00000100:00100000:3.0:1788390309.128794:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097940992 00000100:00100000:3.0:1788390309.128837:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788390309.128844:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1198ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097940992:12345-0@lo:101: 00010000:00010000:3.0:1788390309.128854:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390309.128866:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c3052cdd/0xe156d0713be972c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be972bf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.128885:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3052cdd/0xe156d0713be972c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be972bf expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.128894:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c3052cdd/0xe156d0713be972c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972bf expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.128901:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c3052cdd, rc 0) 00000100:00100000:3.0:1788390309.128940:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1198ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097940992:12345-0@lo:101: Request processed in 96us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390309.128946:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788390309.128975:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acdd2474 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097940992:0@lo:101: 00010000:00010000:3.0:1788390309.128985:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 0000000055016653/0xe156d0713be972bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.128993:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 0000000055016653/0xe156d0713be972bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390309.129042:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097941120:0@lo:501: 00000100:00100000:3.0:1788390309.129066:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.129079:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000813ab6ef going to sleep for 11 seconds 00000100:00100000:0.0:1788390309.129122:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097941120 00000100:00100000:0.0:1788390309.129131:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097941120 00000100:00100000:0.0:1788390309.129161:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788390309.129172:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000089c12c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097941120:12345-0@lo:501: 00000100:00100000:0.0:1788390309.129463:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000089c12c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097941120:12345-0@lo:501: Request processed in 286us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390309.129470:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788390309.132566:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097941120:0@lo:501: 00000100:00100000:3.0:1788390309.132627:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097941248:0@lo:503: 00000100:00100000:3.0:1788390309.132697:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.132729:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000813ab6ef going to sleep for 11 seconds 00000100:00100000:3.0:1788390309.132749:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097941248 00000100:00100000:3.0:1788390309.132755:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097941248 00000100:00100000:3.0:1788390309.132799:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788390309.132807:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7016cee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097941248:12345-0@lo:503: 00000100:00100000:3.0:1788390309.134436:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7016cee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097941248:12345-0@lo:503: Request processed in 1625us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390309.134446:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788390309.134515:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097941248:0@lo:503: 00000100:00100000:3.0:1788390309.134705:0:7523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:7523:1875263097941376:0@lo:502: 00000100:00100000:3.0:1788390309.134751:0:7523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.134773:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097941376 00000100:00100000:3.0:1788390309.134778:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097941376 00000100:00100000:3.0:1788390309.134805:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390309.134811:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000360682e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:7523:x1875263097941376:12345-0@lo:502: 00000100:00100000:3.0:1788390309.134896:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000360682e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:7523:x1875263097941376:12345-0@lo:502: Request processed in 85us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390309.134903:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390309.134932:0:7523:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f3d5257 going to sleep for 11 seconds 00000100:00100000:3.0:1788390309.134943:0:7523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:7523:1875263097941376:0@lo:502: 00000020:01000000:3.0:1788390309.134963:0:7523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390309.134973:0:7523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390309.134976:0:7523:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788390309.134980:0:7523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788390309.134983:0:7523:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:00000080:3.0:1788390309.135004:0:7523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390309.135028:0:7523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000006fa8cb12) 00000020:00000080:3.0:1788390309.135050:0:7523:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788390309.135057:0:7523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788390309.135130:0:7523:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788390309.135135:0:7523:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788390309.135142:0:7523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be972d4 00010000:00080000:3.0:1788390309.135174:0:7523:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008f0b506a@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.111@tcp at head 00010000:00010000:3.0:1788390309.139996:0:7523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788390309.143114:0:7523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390309.143128:0:7523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788390309.143164:0:7523:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788390309.143186:0:7523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be972db 00000100:00080000:3.0:1788390309.143196:0:7523:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390309.143206:0:7523:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000008f0b506a using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390309.143239:0:7523:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000003418e72 x1875263097941504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390309.143265:0:7523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1788390309.143312:0:7523:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788390309.143315:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263097941504:0@lo:38: 00000100:00100000:1.0:1788390309.143413:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390309.143797:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097941504 00000100:00100000:2.0:1788390309.143804:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097941504 00000100:00100000:2.0:1788390309.143844:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390309.143851:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004686ef09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1875263097941504:12345-0@lo:38: 00010000:00080000:2.0:1788390309.143875:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:2.0:1788390309.144001:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be972e2 00000004:00100000:2.0:1788390309.144016:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788390309.144022:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788390309.145553:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026079f25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097941632:0@lo:400: 00000100:00100000:3.0:1788390309.145609:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.145649:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5d2494a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097941760:0@lo:400: 00000100:00100000:3.0:1788390309.145675:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.145692:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390309.145697:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097941888:0@lo:400: 00000100:00100000:3.0:1788390309.145716:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.145748:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097941632 00000100:00100000:3.0:1788390309.145754:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097941632 00000100:00100000:3.0:1788390309.145785:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097941888 00000100:00100000:3.0:1788390309.145788:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097941888 00000100:00100000:3.0:1788390309.145804:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390309.145811:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ab2951d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097941632:12345-0@lo:400: 00000100:00100000:3.0:1788390309.145857:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ab2951d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097941632:12345-0@lo:400: Request processed in 46us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390309.145863:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390309.145879:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390309.145884:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d23a094 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097941888:12345-0@lo:400: 00000100:00100000:3.0:1788390309.145931:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d23a094 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097941888:12345-0@lo:400: Request processed in 47us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390309.145937:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390309.145966:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788390309.145976:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:3.0:1788390309.146085:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006f336daa x1875263097941888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390309.146098:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097941888:0@lo:400: 00010000:00080000:3.0:1788390309.146120:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000026079f25 x1875263097941632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390309.146129:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026079f25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097941632:0@lo:400: 00000100:00080000:2.0:1788390309.146279:0:7526:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000006cc76a66 x1875263097942016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390309.146289:0:7526:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ebe88c8 going to sleep for 0 seconds 00000020:01000000:3.0:1788390309.146585:0:7523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390309.146591:0:7523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390309.146594:0:7523:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788390309.146597:0:7523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390309.146601:0:7523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390309.146602:0:7523:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788390309.146605:0:7523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390309.146607:0:7523:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788390309.146626:0:7523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026079f25 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:7523:1875263097942144:0@lo:502: 00000100:00100000:3.0:1788390309.146666:0:7523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.146732:0:7523:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6caa096 going to sleep for 11 seconds 00000100:00100000:0.0:1788390309.148405:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097941760 00000100:00100000:0.0:1788390309.148414:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097941760 00000100:00100000:0.0:1788390309.149205:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390309.149216:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8bdac3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097941760:12345-0@lo:400: 00000100:00100000:0.0:1788390309.149314:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8bdac3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097941760:12345-0@lo:400: Request processed in 100us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390309.149398:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390309.149446:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5d2494a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097941760:0@lo:400: 00000100:00100000:2.0:1788390309.151608:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097942144 00000100:00100000:2.0:1788390309.151620:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097942144 00000100:00100000:2.0:1788390309.153439:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788390309.153453:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa14e584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:7523:x1875263097942144:12345-0@lo:502: 00000100:00100000:2.0:1788390309.153639:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa14e584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:7523:x1875263097942144:12345-0@lo:502: Request processed in 190us (6972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.153646:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788390309.156619:0:7523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026079f25 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:7523:1875263097942144:0@lo:502: 00000020:01000000:3.0:1788390309.156667:0:7523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390309.156675:0:7523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390309.156677:0:7523:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788390309.156681:0:7523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788390309.156745:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788390309.156762:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788390309.156770:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 0000000055016653/0xe156d0713be972bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.156781:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 0000000055016653/0xe156d0713be972bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390309.156797:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788390309.156800:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984f88c4cd28 from 1 10000000:01000000:3.0:1788390309.156803:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788390309.156834:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be972e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.156841:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be972e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.156850:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be972e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390309.156866:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026079f25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097942272:0@lo:101: 00000100:00100000:3.0:1788390309.156919:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.156957:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a37a246d going to sleep for 11 seconds 00000100:00100000:2.0:1788390309.157094:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097942272 00000100:00100000:2.0:1788390309.157101:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097942272 00000100:00100000:2.0:1788390309.157137:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788390309.157145:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b068fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097942272:12345-0@lo:101: 00010000:00010000:2.0:1788390309.157159:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390309.157187:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f20849c/0xe156d0713be972f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be972e9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.157210:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f20849c/0xe156d0713be972f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be972e9 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.157218:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f20849c/0xe156d0713be972f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972e9 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390309.157227:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f20849c, rc 0) 00000100:00100000:2.0:1788390309.157259:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b068fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097942272:12345-0@lo:101: Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.157266:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788390309.157450:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026079f25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097942272:0@lo:101: 00010000:00010000:3.0:1788390309.159831:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be972e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390309.159850:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be972e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390309.159932:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026079f25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097942400:0@lo:501: 00000100:00100000:3.0:1788390309.159987:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.160024:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a37a246d going to sleep for 11 seconds 00000100:00100000:3.0:1788390309.163186:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097942400 00000100:00100000:3.0:1788390309.163201:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097942400 00000100:00100000:3.0:1788390309.163265:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788390309.163282:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019877449 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097942400:12345-0@lo:501: 00000100:00100000:3.0:1788390309.164754:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019877449 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097942400:12345-0@lo:501: Request processed in 1469us (4762us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390309.164766:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788390309.172565:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026079f25 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097942400:0@lo:501: 00000100:00080000:0.0:1788390309.178010:0:6498:0:(import.c:65:import_set_state_nolock()) 000000003bab7d01 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390309.178117:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004686ef09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875263097941504:12345-0@lo:38: Request processed in 34264us (34703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390309.178128:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390309.178452:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788390309.178471:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788390309.178479:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788390309.178484:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788390309.178486:0:3621:0:(import.c:65:import_set_state_nolock()) 000000008f0b506a lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788390309.178502:0:3621:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005ebe88c8): req@000000006cc76a66 x1875263097942016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390309.178519:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003418e72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263097941504:0@lo:38: 00000100:00100000:2.0:1788390309.178586:0:7526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390309.178622:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097942016 00000100:00100000:2.0:1788390309.178628:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097942016 00000100:00100000:2.0:1788390309.178672:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390309.178681:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c342ccc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7526:x1875263097942016:12345-0@lo:1000: 00000100:00100000:2.0:1788390309.178739:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c342ccc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7526:x1875263097942016:12345-0@lo:1000: Request processed in 60us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.178746:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390309.178778:0:7526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097942016:0@lo:1000: 00000040:01000000:2.0:1788390309.178808:0:7526:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788390309.178842:0:7526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097942528:0@lo:1000: 00000100:00100000:2.0:1788390309.178869:0:7526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390309.178889:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097942528 00000100:00100000:2.0:1788390309.178893:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097942528 00000100:00100000:2.0:1788390309.178914:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390309.178919:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce91f2c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7526:x1875263097942528:12345-0@lo:1000: 00000100:00100000:2.0:1788390309.178994:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce91f2c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7526:x1875263097942528:12345-0@lo:1000: Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.179000:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390309.179016:0:7526:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e56bece going to sleep for 11 seconds 00000100:00100000:2.0:1788390309.179027:0:7526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097942528:0@lo:1000: 00000100:00100000:2.0:1788390309.179062:0:7526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097942656:0@lo:700: 00000100:00100000:2.0:1788390309.179086:0:7526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390309.179110:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097942656 00000100:00100000:2.0:1788390309.179114:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097942656 00000100:00100000:2.0:1788390309.179139:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390309.179144:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000823681b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7526:x1875263097942656:12345-0@lo:700: 00000100:00100000:2.0:1788390309.179174:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000823681b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7526:x1875263097942656:12345-0@lo:700: Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.179187:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390309.179205:0:7526:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb9fd664 going to sleep for 11 seconds 00000100:00100000:2.0:1788390309.179218:0:7526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097942656:0@lo:700: 00000100:00100000:2.0:1788390309.179408:0:7526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097942784:0@lo:1000: 00000100:00100000:2.0:1788390309.179434:0:7526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390309.179452:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097942784 00000100:00100000:2.0:1788390309.179455:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097942784 00000100:00100000:2.0:1788390309.179473:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390309.179478:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a136c18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7526:x1875263097942784:12345-0@lo:1000: 00000100:00100000:2.0:1788390309.179517:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a136c18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7526:x1875263097942784:12345-0@lo:1000: Request processed in 38us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.179523:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390309.179538:0:7526:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e99099af going to sleep for 11 seconds 00000100:00100000:2.0:1788390309.179549:0:7526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097942784:0@lo:1000: 00000004:00080000:2.0:1788390309.179582:0:7526:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000eb9fd664 with version 0 00000020:00100000:2.0:1788390309.179596:0:7526:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788390309.179600:0:7526:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006cc76a66 x1875263097943040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390309.179612:0:7526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097943040:0@lo:1000: 00000100:00100000:2.0:1788390309.179632:0:7526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390309.179648:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097943040 00000100:00100000:2.0:1788390309.179652:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097943040 00000100:00100000:2.0:1788390309.179672:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390309.179677:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b6d579c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7526:x1875263097943040:12345-0@lo:1000: 00000100:00100000:2.0:1788390309.180133:0:7526:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b14786b going to sleep for 11 seconds 00000100:00100000:0.0:1788390309.183389:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051def39a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097943168:0@lo:41: 00000100:00100000:0.0:1788390309.183574:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788390309.183709:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788390309.183720:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be972e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390309.183732:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: 0000000070e1f610/0xe156d0713be972e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390309.186603:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097943168 00000100:00100000:1.0:1788390309.186618:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097943168 00000100:00100000:1.0:1788390309.186671:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390309.186679:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066085cee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3624:x1875263097943168:12345-0@lo:41: 00000004:00000024:1.0:1788390309.186715:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788390309.186803:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066085cee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3624:x1875263097943168:12345-0@lo:41: Request processed in 125us (3229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390309.186809:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390309.186871:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051def39a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097943168:0@lo:41: 00000001:00080000:1.0:1788390309.190556:0:7423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788390309.190573:0:7423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788390309.190827:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b6d579c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7526:x1875263097943040:12345-0@lo:1000: Request processed in 11145us (11191us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788390309.190839:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1788390309.195993:0:7526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788390309.196002:0:7526:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788390309.196020:0:7526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097943040:0@lo:1000: 00000100:00100000:3.0:1788390309.196106:0:7526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097943296:0@lo:1000: 00000100:00100000:3.0:1788390309.196161:0:7526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390309.196196:0:7526:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093cad4d5 going to sleep for 11 seconds 00000100:00100000:2.0:1788390309.196818:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097943296 00000100:00100000:2.0:1788390309.196826:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097943296 00000100:00100000:2.0:1788390309.198375:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390309.198388:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000976e0434 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7526:x1875263097943296:12345-0@lo:1000: 00000100:00100000:2.0:1788390309.198510:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000976e0434 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7526:x1875263097943296:12345-0@lo:1000: Request processed in 125us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390309.198517:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390309.198674:0:7526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f336daa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7526:1875263097943296:0@lo:1000: 00000040:00080000:3.0:1788390309.198697:0:7526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788390309.198732:0:7526:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000008cc18677 with version 1 00000004:00080000:1.0:1788390309.198862:0:7524:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000002f3d5257 version 1 rpc_version 1 00000020:00100000:1.0:1788390309.198883:0:7524:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788390309.198889:0:7524:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009579e992 x1875263097943552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390309.198905:0:7524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009579e992 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7524:1875263097943552:0@lo:1000: 00000100:00100000:1.0:1788390309.198940:0:7524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788390309.200988:0:7526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788390309.201064:0:7526:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788390309.201069:0:7526:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1788390309.206190:0:7524:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e38733a going to sleep for 11 seconds 00000100:00100000:0.0:1788390309.206440:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097943552 00000100:00100000:0.0:1788390309.207416:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097943552 00000100:00100000:0.0:1788390309.207556:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390309.207564:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091df2a3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7524:x1875263097943552:12345-0@lo:1000: 00000001:00080000:3.0:1788390309.230197:0:7423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788390309.230399:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091df2a3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7524:x1875263097943552:12345-0@lo:1000: Request processed in 22833us (31456us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788390309.230413:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788390309.231541:0:7524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788390309.231548:0:7524:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788390309.231566:0:7524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009579e992 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7524:1875263097943552:0@lo:1000: 00010000:00010000:0.0:1788390310.033622:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390311.057490:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390312.067601:0:7697:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788390312.083574:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390312.529525:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390312.529552:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097943680:0@lo:41: 00000100:00100000:1.0:1788390312.529632:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390312.529768:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097943680 00000100:00100000:2.0:1788390312.529778:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097943680 00000100:00100000:2.0:1788390312.529833:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390312.529842:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fb935db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097943680:12345-0@lo:41: 00000004:00000024:2.0:1788390312.529877:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788390312.529927:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fb935db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097943680:12345-0@lo:41: Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390312.529934:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390312.529978:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e87cd66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097943680:0@lo:41: 00010000:00010000:2.0:1788390313.111713:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788390313.175116:0:7750:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390313.175637:0:7750:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788390314.132522:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390314.579678:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390314.579704:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034f4f1bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097943808:0@lo:41: 00000100:00100000:2.0:1788390314.579799:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390314.579989:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097943808 00000100:00100000:0.0:1788390314.579998:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097943808 00000100:00100000:0.0:1788390314.580053:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390314.580062:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e87cd66 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097943808:12345-0@lo:41: 00000004:00000024:0.0:1788390314.580100:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788390314.580156:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e87cd66 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097943808:12345-0@lo:41: Request processed in 95us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390314.580164:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390314.580260:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034f4f1bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097943808:0@lo:41: 00000100:00100000:1.0:1788390314.582074:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010d522fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097943936:0@lo:400: 00000100:00100000:1.0:1788390314.582140:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390314.582191:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390314.582197:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064f6d328 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263097944320:0@lo:400: 00000100:00100000:1.0:1788390314.582224:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390314.582305:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097943936 00000100:00100000:0.0:1788390314.582314:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097943936 00000100:00100000:0.0:1788390314.582395:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788390314.582403:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dbd5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:3623:x1875263097943936:12345-0@lo:400: 00000100:00100000:0.0:1788390314.582462:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dbd5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:3623:x1875263097943936:12345-0@lo:400: Request processed in 60us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390314.582479:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788390314.582621:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005eabe63d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097944192:0@lo:400: 00000100:00100000:3.0:1788390314.582651:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390314.582679:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390314.582684:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d077dc5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097944064:0@lo:400: 00000100:00100000:3.0:1788390314.582703:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390314.582731:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097944320 00000100:00100000:3.0:1788390314.582734:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097944320 00000100:00100000:3.0:1788390314.582780:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097944064 00000100:00100000:3.0:1788390314.582797:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097944064 00000100:00100000:3.0:1788390314.582818:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390314.582824:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fe1a7e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263097944320:12345-0@lo:400: 00000100:00100000:3.0:1788390314.582858:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fe1a7e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263097944320:12345-0@lo:400: Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390314.582864:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390314.582877:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390314.582882:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058fdb729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097944064:12345-0@lo:400: 00000100:00100000:3.0:1788390314.582913:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058fdb729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097944064:12345-0@lo:400: Request processed in 31us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390314.582919:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788390314.582958:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d077dc5b x1875263097944064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390314.582973:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d077dc5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097944064:0@lo:400: 00010000:00080000:1.0:1788390314.583216:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000064f6d328 x1875263097944320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390314.583226:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064f6d328 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263097944320:0@lo:400: 00000100:00100000:1.0:1788390314.583235:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010d522fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097943936:0@lo:400: 00000100:00100000:0.0:1788390314.583313:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097944192 00000100:00100000:0.0:1788390314.583318:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097944192 00000100:00100000:0.0:1788390314.583375:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788390314.583383:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f336daa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097944192:12345-0@lo:400: 00000100:00100000:0.0:1788390314.583450:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f336daa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097944192:12345-0@lo:400: Request processed in 69us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390314.583457:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788390314.583666:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005eabe63d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097944192:0@lo:400: 00010000:00010000:2.0:1788390315.154472:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788390315.950110:0:7851:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390315.955624:0:7851:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788390316.179030:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788390316.964304:0:7899:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd93695540 20000000:00000080:1.0:1788390316.964415:0:7899:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984fb7b6d000 uarg=0000000000000000 20000000:01000000:1.0:1788390316.964461:0:7899:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788390316.964470:0:7899:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788390316.964475:0:7899:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788390316.964810:0:7899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788390316.964824:0:7899:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788390316.968527:0:7899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390316.968810:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788390316.968848:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788390316.968867:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788390316.968895:0:7899:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788390316.968917:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390316.968937:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9716f expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390316.968944:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9725d expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390316.968951:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390316.968992:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9725d expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390316.969008:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9725d expref: 17 pid: 6487 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390316.969022:0:7899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006564da86 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7899:1875263097944448:0@lo:104: 00000100:00100000:1.0:1788390316.969095:0:7899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390316.969172:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9716f expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390316.969180:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9716f expref: 17 pid: 6486 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390316.969187:0:7899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002842c1d8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7899:1875263097944576:0@lo:104: 00000100:00100000:1.0:1788390316.969207:0:7899:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b833124a going to sleep for 11 seconds 00000100:00100000:0.0:1788390316.969476:0:6475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788390316.969498:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390316.969524:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097944448 00000100:00100000:0.0:1788390316.969532:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097944448 00000100:00100000:0.0:1788390316.969584:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097944576 00000100:00100000:0.0:1788390316.969587:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097944576 00000100:00100000:0.0:1788390316.969600:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390316.969609:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c1128cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+4:7899:x1875263097944448:12345-0@lo:104: 00010000:00010000:0.0:1788390316.969621:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.969680:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390316.969685:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c1128cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+4:7899:x1875263097944448:12345-0@lo:104: Request processed in 77us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390316.969692:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390316.969831:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390316.969838:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c1844f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:7899:x1875263097944576:12345-0@lo:104: 00010000:00010000:0.0:1788390316.969845:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.969879:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788390316.969883:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c1844f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:7899:x1875263097944576:12345-0@lo:104: Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390316.969889:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788390316.969918:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390316.969925:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.969933:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005480cbed already unused, calling callback (00000000cea255f4) 10000000:00010000:0.0:1788390316.969936:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.969944:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390316.969951:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390316.969956:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390316.969989:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.969996:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390316.970017:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970023:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: 000000005480cbed/0xe156d0713be9725d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97264 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970038:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390316.970040:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970046:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a3cad6c already unused, calling callback (00000000cea255f4) 10000000:00010000:0.0:1788390316.970048:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970061:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390316.970065:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390316.970070:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390316.970084:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970091:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390316.970105:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970110:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: 000000004a3cad6c/0xe156d0713be9716f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97176 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970125:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390316.970126:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390316.970128:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390316.970134:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390316.970156:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f13cbde0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097944704:0@lo:103: 00000100:00100000:0.0:1788390316.970190:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390316.970244:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005eabe63d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097944832:0@lo:103: 00000100:00100000:0.0:1788390316.970268:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390316.970308:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097944704 00000100:00100000:0.0:1788390316.970312:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097944704 00010000:00010000:0.0:1788390316.970368:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9725d expref: 18 pid: 6487 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390316.970403:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097944832 00000100:00100000:0.0:1788390316.970406:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097944832 00010000:00010000:0.0:1788390316.970419:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9716f expref: 19 pid: 6486 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390316.970431:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390316.970437:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010d522fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3623:x1875263097944704:12345-0@lo:103: 00010000:00010000:0.0:1788390316.970446:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390316.970451:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9725d expref: 19 pid: 6487 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970461:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9725d expref: 19 pid: 6487 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970477:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390316.970504:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010d522fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3623:x1875263097944704:12345-0@lo:103: Request processed in 68us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390316.970511:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390316.970524:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390316.970530:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064f6d328 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:3624:x1875263097944832:12345-0@lo:103: 00010000:00010000:0.0:1788390316.970537:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390316.970689:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2c88e7d/0xe156d0713be97264 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9725d expref: 18 pid: 6487 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390316.970713:0:7899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006564da86 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7899:1875263097944448:0@lo:104: 00000100:00100000:1.0:1788390316.970736:0:7899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002842c1d8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7899:1875263097944576:0@lo:104: 00010000:00010000:1.0:1788390316.970754:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970921:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9716f expref: 17 pid: 6486 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970930:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9716f expref: 17 pid: 6486 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970939:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000639dafca/0xe156d0713be97176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9716f expref: 17 pid: 6486 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970958:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970965:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970977:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970984:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970990:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.970995:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.971000:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e7d62b56 already unused, calling callback (00000000a949f04c) 00010000:00010000:0.0:1788390316.971004:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.971010:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.971029:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390316.971038:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390316.971069:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064f6d328 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:3624:x1875263097944832:12345-0@lo:103: Request processed in 540us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390316.971086:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390316.971120:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005eabe63d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097944832:0@lo:103: 00000100:00100000:0.0:1788390316.971138:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f13cbde0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097944704:0@lo:103: 00010000:00010000:1.0:1788390316.971272:0:7899:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390316.971280:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390316.971285:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e7d62b56/0xe156d0713be972f7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390317.226617:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390317.652080:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390317.652241:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9878374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097944960:0@lo:41: 00000100:00100000:2.0:1788390317.655353:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390317.655721:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097944960 00000100:00100000:1.0:1788390317.655730:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097944960 00000100:00100000:1.0:1788390317.655784:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390317.655793:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071d57163 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097944960:12345-0@lo:41: 00000004:00000024:1.0:1788390317.655833:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788390317.655924:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071d57163 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097944960:12345-0@lo:41: Request processed in 132us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390317.655930:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788390317.656012:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9878374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097944960:0@lo:41: 00010000:00010000:1.0:1788390318.230573:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390319.252461:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390319.699194:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263097945472:0@lo:400: 00000100:00100000:2.0:1788390319.699280:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390319.699484:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b4581a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097945344:0@lo:400: 00000100:00100000:3.0:1788390319.699517:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390319.699554:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097945472 00000100:00100000:3.0:1788390319.699561:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097945472 00000100:00100000:3.0:1788390319.699602:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390319.699610:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe1f356 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263097945472:12345-0@lo:400: 00000100:00100000:3.0:1788390319.699656:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe1f356 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263097945472:12345-0@lo:400: Request processed in 47us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.699663:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390319.699693:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097945344 00000100:00100000:3.0:1788390319.699707:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097945344 00000100:00100000:3.0:1788390319.699733:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390319.699740:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9878374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097945344:12345-0@lo:400: 00000100:00100000:3.0:1788390319.699778:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9878374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097945344:12345-0@lo:400: Request processed in 40us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.699783:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390319.699822:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b4581a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097945344:0@lo:400: 00010000:00080000:2.0:1788390319.699923:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006cc76a66 x1875263097945472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390319.699934:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cc76a66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263097945472:0@lo:400: 00000100:00100000:0.0:1788390319.700188:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051327790 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097945088:0@lo:400: 00000100:00100000:0.0:1788390319.700235:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.700267:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcadc17e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097945600:0@lo:400: 00000100:00100000:0.0:1788390319.700290:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.700315:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788390319.700352:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097945216:0@lo:400: 00000100:00100000:0.0:1788390319.700595:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390319.700622:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f13cbde0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097945728:0@lo:41: 00000100:00100000:0.0:1788390319.700642:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390319.700703:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097945216 00000100:00100000:1.0:1788390319.700709:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097945216 00000100:00100000:1.0:1788390319.700748:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390319.700754:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d077dc5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097945216:12345-0@lo:400: 00000100:00100000:1.0:1788390319.700804:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d077dc5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097945216:12345-0@lo:400: Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390319.700811:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788390319.700842:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000b9f56b6 x1875263097945216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390319.700854:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b9f56b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097945216:0@lo:400: 00000100:00100000:2.0:1788390319.700965:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097945600 00000100:00100000:2.0:1788390319.700970:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097945600 00000100:00100000:2.0:1788390319.701002:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097945728 00000100:00100000:2.0:1788390319.701005:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097945728 00000100:00100000:2.0:1788390319.701019:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788390319.701025:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005eabe63d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263097945600:12345-0@lo:400: 00000100:00100000:2.0:1788390319.701061:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005eabe63d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263097945600:12345-0@lo:400: Request processed in 37us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390319.701067:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788390319.701080:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390319.701085:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034f4f1bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097945728:12345-0@lo:41: 00000004:00000024:2.0:1788390319.701106:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788390319.701135:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034f4f1bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097945728:12345-0@lo:41: Request processed in 50us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390319.701140:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390319.701238:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097945088 00000100:00100000:3.0:1788390319.701244:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097945088 00000100:00100000:3.0:1788390319.701279:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788390319.701286:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be1c0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:3622:x1875263097945088:12345-0@lo:400: 00000100:00100000:3.0:1788390319.701339:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be1c0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:3622:x1875263097945088:12345-0@lo:400: Request processed in 33us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390319.701356:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788390319.701791:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f13cbde0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097945728:0@lo:41: 00000100:00100000:1.0:1788390319.701802:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051327790 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097945088:0@lo:400: 00000100:00100000:1.0:1788390319.701810:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcadc17e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097945600:0@lo:400: 00010000:00010000:0.0:1788390320.279638:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390321.299442:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390322.322688:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390322.769710:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390322.769733:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b17b138 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097945856:0@lo:41: 00000100:00100000:0.0:1788390322.769806:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390322.769876:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097945856 00000100:00100000:0.0:1788390322.769883:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097945856 00000100:00100000:0.0:1788390322.769925:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390322.769932:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051def39a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097945856:12345-0@lo:41: 00000004:00000024:0.0:1788390322.769965:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788390322.770002:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051def39a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097945856:12345-0@lo:41: Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390322.770009:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390322.770058:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b17b138 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097945856:0@lo:41: 10000000:01000000:2.0:1788390323.282860:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390323.282868:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fb76a1000 from 1 10000000:01000000:2.0:1788390323.282873:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390323.282918:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: 0000000069b5a2d6/0xe156d0713be972fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390323.282931:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: 0000000069b5a2d6/0xe156d0713be972fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390323.282942:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: 0000000069b5a2d6/0xe156d0713be972fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390323.282964:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb178ea6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097945984:0@lo:101: 00000100:00100000:2.0:1788390323.283033:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390323.283083:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086148f06 going to sleep for 11 seconds 00000100:00100000:1.0:1788390323.283164:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097945984 00000100:00100000:1.0:1788390323.283185:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097945984 00000100:00100000:1.0:1788390323.283238:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788390323.283247:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcd63d67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097945984:12345-0@lo:101: 00010000:00010000:1.0:1788390323.283263:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390323.283275:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005107a5ae/0xe156d0713be97305 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be972fe expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390323.283297:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005107a5ae/0xe156d0713be97305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be972fe expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390323.283308:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005107a5ae/0xe156d0713be97305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972fe expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390323.283317:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005107a5ae, rc 0) 00000100:00100000:1.0:1788390323.283385:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcd63d67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097945984:12345-0@lo:101: Request processed in 140us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390323.283404:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788390323.283494:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb178ea6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097945984:0@lo:101: 00010000:00010000:0.0:1788390323.283509:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: 0000000069b5a2d6/0xe156d0713be972fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390323.283518:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: 0000000069b5a2d6/0xe156d0713be972fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390323.283581:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acdd2474 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946112:0@lo:501: 00000100:00100000:0.0:1788390323.283609:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390323.283640:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034c46d8a going to sleep for 11 seconds 00000100:00100000:1.0:1788390323.283773:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097946112 00000100:00100000:1.0:1788390323.283779:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097946112 00000100:00100000:1.0:1788390323.283810:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788390323.283816:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000464fdf28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097946112:12345-0@lo:501: 00000100:00100000:1.0:1788390323.283938:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000464fdf28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097946112:12345-0@lo:501: Request processed in 122us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390323.283945:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788390323.284041:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acdd2474 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946112:0@lo:501: 00000100:00100000:0.0:1788390323.284070:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acdd2474 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946240:0@lo:503: 00000100:00100000:0.0:1788390323.284110:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390323.284131:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034c46d8a going to sleep for 11 seconds 00000100:00100000:2.0:1788390323.284196:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097946240 00000100:00100000:2.0:1788390323.284201:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097946240 00000100:00100000:2.0:1788390323.284233:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788390323.284240:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d0a3f6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097946240:12345-0@lo:503: 00000100:00100000:2.0:1788390323.284356:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d0a3f6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097946240:12345-0@lo:503: Request processed in 116us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390323.284363:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788390323.284495:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acdd2474 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946240:0@lo:503: 00000100:00100000:0.0:1788390323.290485:0:8221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acdd2474 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8221:1875263097946368:0@lo:502: 00000100:00100000:0.0:1788390323.290559:0:8221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390323.290597:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097946368 00000100:00100000:0.0:1788390323.290603:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097946368 00000100:00100000:0.0:1788390323.290641:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788390323.290648:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0a9f4f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:8221:x1875263097946368:12345-0@lo:502: 00000100:00100000:0.0:1788390323.290770:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0a9f4f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:8221:x1875263097946368:12345-0@lo:502: Request processed in 122us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390323.290778:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788390323.290842:0:8221:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034c46d8a going to sleep for 11 seconds 00000100:00100000:0.0:1788390323.290866:0:8221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acdd2474 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8221:1875263097946368:0@lo:502: 00000020:01000000:0.0:1788390323.290893:0:8221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390323.290902:0:8221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390323.290905:0:8221:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788390323.290911:0:8221:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fb76a1000 00000020:00000080:0.0:1788390323.290913:0:8221:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788390323.290954:0:8221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8221:1875263097946496:0@lo:502: 00000100:00100000:0.0:1788390323.290987:0:8221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390323.291007:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097946496 00000100:00100000:0.0:1788390323.291010:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097946496 00000100:00100000:0.0:1788390323.291028:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390323.291033:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:8221:x1875263097946496:12345-0@lo:502: 00000100:00100000:0.0:1788390323.291088:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:8221:x1875263097946496:12345-0@lo:502: Request processed in 53us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390323.291094:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390323.291123:0:8221:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390323.291134:0:8221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8221:1875263097946496:0@lo:502: 00000020:01000000:0.0:1788390323.291151:0:8221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390323.291156:0:8221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390323.291157:0:8221:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788390323.291161:0:8221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788390323.291228:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788390323.291255:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390323.291265:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390323.291276:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390323.291293:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390323.291295:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984f988e6800 from 1 10000000:01000000:0.0:1788390323.291299:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390323.291341:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390323.291347:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390323.291353:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390323.291362:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946624:0@lo:101: 00000100:00100000:0.0:1788390323.291381:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390323.291391:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390323.291400:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097946624 00000100:00100000:0.0:1788390323.291402:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097946624 00000100:00100000:0.0:1788390323.291413:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788390323.291417:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097946624:12345-0@lo:101: 00010000:00010000:0.0:1788390323.291423:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390323.291432:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9730c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390323.291448:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9730c expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390323.291456:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9730c expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390323.291470:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f80030600, rc 0) 00000100:00100000:0.0:1788390323.291489:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097946624:12345-0@lo:101: Request processed in 72us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390323.291493:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788390323.291514:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946624:0@lo:101: 00010000:00010000:0.0:1788390323.291522:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390323.291528:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390323.291554:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946752:0@lo:501: 00000100:00100000:0.0:1788390323.291569:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390323.291577:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390323.291584:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097946752 00000100:00100000:0.0:1788390323.291586:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097946752 00000100:00100000:0.0:1788390323.291596:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788390323.291600:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097946752:12345-0@lo:501: 00000100:00100000:0.0:1788390323.291679:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097946752:12345-0@lo:501: Request processed in 77us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390323.291685:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788390323.291711:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946752:0@lo:501: 00000100:00100000:0.0:1788390323.291733:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946880:0@lo:503: 00000100:00100000:0.0:1788390323.291764:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390323.291778:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390323.291794:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097946880 00000100:00100000:0.0:1788390323.291798:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097946880 00000100:00100000:0.0:1788390323.291814:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788390323.291819:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097946880:12345-0@lo:503: 00000100:00100000:0.0:1788390323.291878:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097946880:12345-0@lo:503: Request processed in 57us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390323.291884:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788390323.291920:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097946880:0@lo:503: 00000100:00100000:0.0:1788390323.293962:0:8223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8223:1875263097947008:0@lo:502: 00000100:00100000:0.0:1788390323.294049:0:8223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390323.294093:0:8223:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390323.294221:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097947008 00000100:00100000:3.0:1788390323.294231:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097947008 00000100:00100000:3.0:1788390323.294286:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788390323.294298:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:8223:x1875263097947008:12345-0@lo:502: 00000100:00100000:3.0:1788390323.294523:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:8223:x1875263097947008:12345-0@lo:502: Request processed in 226us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390323.294532:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788390323.294657:0:8223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8223:1875263097947008:0@lo:502: 00000020:01000000:0.0:1788390323.294688:0:8223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390323.294697:0:8223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390323.294700:0:8223:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788390323.294706:0:8223:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984f988e6800 00000020:00000080:0.0:1788390323.294709:0:8223:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788390323.294733:0:8223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8223:1875263097947136:0@lo:502: 00000100:00100000:0.0:1788390323.294769:0:8223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390323.294792:0:8223:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390323.294830:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097947136 00000100:00100000:3.0:1788390323.294834:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097947136 00000100:00100000:3.0:1788390323.294863:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788390323.294870:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:8223:x1875263097947136:12345-0@lo:502: 00000100:00100000:3.0:1788390323.294939:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:8223:x1875263097947136:12345-0@lo:502: Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390323.294946:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788390323.295015:0:8223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8223:1875263097947136:0@lo:502: 00000020:01000000:0.0:1788390323.295033:0:8223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390323.295038:0:8223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390323.295039:0:8223:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788390323.295042:0:8223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788390323.295227:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788390323.295248:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390323.295257:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390323.295268:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390323.345518:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390324.370408:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390324.821444:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097947264:0@lo:41: 00000100:00100000:2.0:1788390324.821540:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390324.821593:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263097947776:0@lo:400: 00000100:00100000:2.0:1788390324.821619:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390324.821645:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390324.821651:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097947648:0@lo:400: 00000100:00100000:2.0:1788390324.821671:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390324.821719:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097947392:0@lo:400: 00000100:00100000:2.0:1788390324.821750:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390324.821774:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097947904:0@lo:400: 00000100:00100000:2.0:1788390324.821794:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390324.821811:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390324.821816:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097947520:0@lo:400: 00000100:00100000:2.0:1788390324.821837:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390324.821868:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097947264 00000100:00100000:2.0:1788390324.821875:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097947264 00000100:00100000:2.0:1788390324.821913:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097947648 00000100:00100000:2.0:1788390324.821917:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097947648 00000100:00100000:2.0:1788390324.821929:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097947904 00000100:00100000:2.0:1788390324.821932:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097947904 00000100:00100000:2.0:1788390324.821946:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390324.821954:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1875263097947264:12345-0@lo:41: 00000004:00000024:2.0:1788390324.821989:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788390324.822033:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1875263097947264:12345-0@lo:41: Request processed in 80us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390324.822040:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390324.822058:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390324.822064:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097947648:12345-0@lo:400: 00000100:00100000:2.0:1788390324.822090:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097947648:12345-0@lo:400: Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390324.822096:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390324.822107:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390324.822112:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097947904:12345-0@lo:400: 00000100:00100000:2.0:1788390324.822138:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097947904:12345-0@lo:400: Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390324.822149:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390324.822182:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097947776 00000100:00100000:2.0:1788390324.822186:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097947776 00000100:00100000:2.0:1788390324.822208:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097947520 00000100:00100000:2.0:1788390324.822211:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097947520 00000100:00100000:2.0:1788390324.822223:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390324.822228:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263097947776:12345-0@lo:400: 00000100:00100000:2.0:1788390324.822258:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263097947776:12345-0@lo:400: Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390324.822263:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390324.822272:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390324.822278:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097947520:12345-0@lo:400: 00000100:00100000:2.0:1788390324.822302:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097947520:12345-0@lo:400: Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390324.822307:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390324.822346:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097947392 00000100:00100000:2.0:1788390324.822350:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097947392 00000100:00100000:2.0:1788390324.822378:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788390324.822384:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:3622:x1875263097947392:12345-0@lo:400: 00000100:00100000:2.0:1788390324.822413:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:3622:x1875263097947392:12345-0@lo:400: Request processed in 30us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390324.822418:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788390324.822474:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984fbb150700 x1875263097947520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390324.822489:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097947520:0@lo:400: 00000100:00100000:2.0:1788390324.822499:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097947392:0@lo:400: 00000100:00100000:2.0:1788390324.822519:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097947904:0@lo:400: 00000100:00100000:2.0:1788390324.822552:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097947648:0@lo:400: 00000100:00100000:2.0:1788390324.822564:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097947264:0@lo:41: 00010000:00080000:2.0:1788390324.822574:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984fbb151880 x1875263097947776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390324.822584:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263097947776:0@lo:400: 00010000:00010000:3.0:1788390325.393729:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390326.429823:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788390326.873257:0:8399:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788390326.873262:0:8399:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788390326.873264:0:8399:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788390326.873437:0:8399:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984fb7b73800 00000020:01000004:1.0:1788390326.873453:0:8399:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788390326.873467:0:8399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788390326.873482:0:8399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff984fb7b84d28) 00000020:00000080:1.0:1788390326.873498:0:8399:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788390326.961148:0:8399:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788390326.961205:0:8399:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1788390326.997940:0:8399:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788390326.998185:0:8399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788390326.998198:0:8399:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788390326.998213:0:8399:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe156d0713be97321 00000020:01000004:1.0:1788390326.998220:0:8399:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788390326.998242:0:8399:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.111@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788390326.998245:0:8399:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788390326.998251:0:8399:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788390326.998256:0:8399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788390326.998269:0:8399:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff984fb7b80000) 00000020:00000080:1.0:1788390326.998279:0:8399:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1788390327.009804:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390327.010019:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788390327.010025:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788390327.026773:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390327.026792:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788390327.027158:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788390327.027165:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788390327.033734:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390327.034002:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788390327.034009:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788390327.034727:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788390327.034734:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788390327.121968:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390327.122254:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788390327.122261:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788390327.133889:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788390327.133903:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788390327.158819:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788390327.158834:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788390327.160988:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390327.162034:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788390327.162043:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788390327.179964:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788390327.179978:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788390327.336913:0:8399:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390327.337196:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788390327.337204:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788390327.343670:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788390327.343690:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788390327.344618:0:8399:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788390327.344663:0:8399:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788390327.344670:0:8399:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788390327.398484:0:8399:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788390327.398531:0:8399:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.111@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788390327.398536:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788390327.398538:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788390327.398540:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390327.398541:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390327.398555:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390327.398557:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390327.398558:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390327.398560:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390327.398562:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390327.398563:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390327.398565:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390327.398569:0:8399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788390327.398571:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788390327.398573:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788390327.398574:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390327.398575:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390327.398576:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390327.398577:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390327.398584:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390327.398585:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390327.398586:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390327.398587:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390327.398588:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390327.398616:0:8399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788390327.398649:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097948032:0@lo:253: 00000100:00100000:2.0:1788390327.398924:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.398972:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87952780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390327.399108:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097948032 00000100:00100000:0.0:1788390327.399116:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097948032 00000100:00100000:0.0:1788390327.399196:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788390327.399206:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:8399:x1875263097948032:12345-0@lo:253: 20000000:01000000:0.0:1788390327.399236:0:6486:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788390327.399240:0:6486:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788390327.399245:0:6486:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788390327.399248:0:6486:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788390327.399471:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390327.399600:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788390327.399615:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788390327.399631:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788390327.399637:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788390327.399650:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788390327.399666:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788390327.399774:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788390327.399788:0:6486:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.111@tcp 20000000:01000000:0.0:1788390327.399790:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:0.0:1788390327.399804:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788390327.399808:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788390327.399816:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788390327.399819:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:0.0:1788390327.399826:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788390327.399829:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788390327.399836:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788390327.399844:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788390327.399892:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788390327.399902:0:6486:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.111@tcp 20000000:01000000:0.0:1788390327.399903:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:0.0:1788390327.399930:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788390327.399938:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788390327.399951:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788390327.399957:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:0.0:1788390327.399967:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788390327.399971:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788390327.399977:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788390327.399985:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788390327.400360:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788390327.400372:0:6486:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.111@tcp 20000000:01000000:0.0:1788390327.400374:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:0.0:1788390327.400388:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788390327.400394:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788390327.400407:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788390327.400412:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:0.0:1788390327.400424:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788390327.400440:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788390327.400456:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788390327.400473:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788390327.400486:0:6486:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788390327.400489:0:6486:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788390327.400493:0:6486:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788390327.400540:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788390327.400543:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788390327.401022:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788390327.401046:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788390327.401062:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788390327.401277:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788390327.401610:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788390327.401631:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788390327.401643:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788390327.401645:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788390327.401959:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788390327.402117:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788390327.402148:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788390327.402164:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788390327.402173:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788390327.402175:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788390327.402601:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788390327.402627:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788390327.402645:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788390327.402793:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788390327.402813:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788390327.402826:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1788390327.402835:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788390327.402837:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788390327.403083:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788390327.403103:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788390327.403118:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788390327.403275:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788390327.403501:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788390327.403523:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:1.0:1788390327.403541:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788390327.403562:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.403581:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be971fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be971f4 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.403589:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9726b expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.403610:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cf600/0xe156d0713be972aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972a3 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.403617:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf734200/0xe156d0713be972c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972bf expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.403623:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cf200/0xe156d0713be972f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972e9 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.403632:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.403675:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cf200/0xe156d0713be972f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be972e9 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.403691:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fc20cf200/0xe156d0713be972f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be972e9 expref: 18 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.403708:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948160:0@lo:104: 00000100:00100000:1.0:1788390327.403776:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390327.403863:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf734200/0xe156d0713be972c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be972bf expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.403872:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf734200/0xe156d0713be972c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be972bf expref: 18 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.403881:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948288:0@lo:104: 00000100:00100000:1.0:1788390327.403904:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390327.403988:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cf600/0xe156d0713be972aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be972a3 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.404001:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fc20cf600/0xe156d0713be972aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be972a3 expref: 18 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.404010:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948416:0@lo:104: 00000100:00100000:1.0:1788390327.404034:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.404082:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097948160 00000100:00100000:2.0:1788390327.404091:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097948160 00000100:00100000:2.0:1788390327.404142:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097948288 00000100:00100000:2.0:1788390327.404145:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097948288 00000100:00100000:2.0:1788390327.404162:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390327.404172:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6486:x1875263097948160:12345-0@lo:104: 00010000:00010000:2.0:1788390327.404185:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be972e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.404249:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390327.404255:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6486:x1875263097948160:12345-0@lo:104: Request processed in 86us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.404263:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390327.404282:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788390327.404395:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390327.404403:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be972e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.404410:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734e00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390327.404414:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be972e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.404422:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be972e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390327.404430:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be972e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390327.404436:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390327.404469:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be972e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.404476:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390327.404496:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be972e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.404504:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be972e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972f0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.404526:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390327.404528:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390327.404530:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390327.404545:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097948544:0@lo:103: 00000100:00100000:0.0:1788390327.404576:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.404619:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097948544 00000100:00100000:0.0:1788390327.404623:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097948544 00010000:00010000:0.0:1788390327.404643:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cf200/0xe156d0713be972f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972e9 expref: 19 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390327.404666:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390327.404672:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3623:x1875263097948544:12345-0@lo:103: 00010000:00010000:0.0:1788390327.404682:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390327.404687:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cf200/0xe156d0713be972f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972e9 expref: 19 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.404698:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cf200/0xe156d0713be972f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be972e9 expref: 19 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.404715:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390327.404740:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3623:x1875263097948544:12345-0@lo:103: Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.404747:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390327.404783:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097948544:0@lo:103: 00000100:00100000:2.0:1788390327.404863:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6486:x1875263097948288:12345-0@lo:104: 00010000:00010000:2.0:1788390327.404872:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be972bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.404904:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390327.404909:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6486:x1875263097948288:12345-0@lo:104: Request processed in 621us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.404915:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788390327.404977:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390327.404982:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be972bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.404999:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80030400 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390327.405002:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be972bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.405009:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be972bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390327.405016:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be972bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390327.405021:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390327.405037:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be972bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.405043:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390327.405066:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be972bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.405072:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be972bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972c6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.405081:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390327.405083:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390327.405084:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390327.405091:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390327.405100:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097948672:0@lo:103: 00000100:00100000:0.0:1788390327.405124:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.405159:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097948672 00000100:00100000:0.0:1788390327.405163:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097948672 00010000:00010000:0.0:1788390327.405182:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf734200/0xe156d0713be972c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972bf expref: 19 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390327.405199:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390327.405204:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3625:x1875263097948672:12345-0@lo:103: 00010000:00010000:0.0:1788390327.405210:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390327.405213:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf734200/0xe156d0713be972c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972bf expref: 19 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.405221:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf734200/0xe156d0713be972c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be972bf expref: 19 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.405230:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390327.405253:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3625:x1875263097948672:12345-0@lo:103: Request processed in 49us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.405259:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390327.405280:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097948672:0@lo:103: 00010000:00010000:1.0:1788390327.405538:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9726b expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.405549:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9726b expref: 18 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.405557:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948800:0@lo:104: 00000100:00100000:1.0:1788390327.405579:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390327.405728:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be971fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be971f4 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.405737:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be971fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be971f4 expref: 18 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.405745:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948928:0@lo:104: 00000100:00100000:1.0:1788390327.405767:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.405785:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097948416 00000100:00100000:3.0:1788390327.405789:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097948416 00000100:00100000:3.0:1788390327.405813:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097948800 00000100:00100000:3.0:1788390327.405816:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097948800 00000100:00100000:3.0:1788390327.405829:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390327.405844:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6486:x1875263097948416:12345-0@lo:104: 00010000:00010000:3.0:1788390327.405853:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be972a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.405897:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390327.405903:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6486:x1875263097948416:12345-0@lo:104: Request processed in 61us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.405909:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390327.405923:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390327.405930:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6486:x1875263097948800:12345-0@lo:104: 00010000:00010000:3.0:1788390327.405937:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be9726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.405970:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788390327.405976:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6486:x1875263097948800:12345-0@lo:104: Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.405982:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788390327.406004:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390327.406008:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be972a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406015:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cea00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390327.406018:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be972a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406025:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be972a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390327.406031:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be972a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390327.406044:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788390327.406065:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be972a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406071:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390327.406084:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be972a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406091:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be972a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972aa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406103:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390327.406106:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be9726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406111:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390327.406114:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be9726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406121:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be9726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390327.406127:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be9726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390327.406144:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788390327.406158:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be9726b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406164:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390327.406186:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be9726b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406194:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be9726b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97272 expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406204:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390327.406207:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390327.406209:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390327.406219:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390327.406231:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097949056:0@lo:103: 00000100:00100000:3.0:1788390327.406272:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.406311:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097949184:0@lo:103: 00000100:00100000:3.0:1788390327.406360:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.406393:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097949056 00000100:00100000:3.0:1788390327.406397:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097949056 00010000:00010000:3.0:1788390327.406415:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cf600/0xe156d0713be972aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972a3 expref: 19 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390327.406434:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097949184 00000100:00100000:3.0:1788390327.406437:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097949184 00010000:00010000:3.0:1788390327.406448:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97272 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9726b expref: 20 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390327.406460:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390327.406466:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:3624:x1875263097949056:12345-0@lo:103: 00010000:00010000:3.0:1788390327.406475:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390327.406479:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cf600/0xe156d0713be972aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972a3 expref: 20 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406498:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cf600/0xe156d0713be972aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be972a3 expref: 20 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406510:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390327.406539:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:3624:x1875263097949056:12345-0@lo:103: Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.406546:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390327.406559:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390327.406566:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3622:x1875263097949184:12345-0@lo:103: 00010000:00010000:3.0:1788390327.406574:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390327.406579:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97272 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9726b expref: 19 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406588:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9726b expref: 19 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.406597:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390327.406620:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3622:x1875263097949184:12345-0@lo:103: Request processed in 54us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.406625:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390327.406653:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097949184:0@lo:103: 00000100:00100000:3.0:1788390327.406672:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097949056:0@lo:103: 00010000:00010000:0.0:1788390327.406764:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390327.407043:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f828b9780 going to sleep for 11 seconds 00010000:00010000:1.0:1788390327.407058:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cf200/0xe156d0713be972f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be972e9 expref: 18 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.407070:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948160:0@lo:104: 00010000:00010000:1.0:1788390327.407079:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf734200/0xe156d0713be972c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be972bf expref: 17 pid: 6484 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.407100:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948288:0@lo:104: 00010000:00010000:1.0:1788390327.407113:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cf600/0xe156d0713be972aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be972a3 expref: 16 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.407120:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948416:0@lo:104: 00010000:00010000:1.0:1788390327.407139:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9726b expref: 15 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.407147:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948800:0@lo:104: 00000100:00100000:3.0:1788390327.407186:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097948928 00000100:00100000:3.0:1788390327.407191:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097948928 00000100:00100000:3.0:1788390327.407255:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390327.407263:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6486:x1875263097948928:12345-0@lo:104: 00010000:00010000:3.0:1788390327.407282:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be971f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.407393:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390327.407400:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6486:x1875263097948928:12345-0@lo:104: Request processed in 138us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.407406:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788390327.407455:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390327.407460:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be971f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.407467:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390327.407471:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be971f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.407479:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be971f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390327.407486:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be971f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390327.407499:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390327.407524:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be971f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.407530:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390327.407542:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be971f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.407548:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be971f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be971fb expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.407560:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390327.407562:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390327.407563:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390327.407671:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6486:1875263097948928:0@lo:104: 00010000:00010000:1.0:1788390327.407692:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390327.407775:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390327.407786:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097949312:0@lo:103: 00000100:00100000:3.0:1788390327.407818:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390327.407911:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097949312 00000100:00100000:0.0:1788390327.407916:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097949312 00010000:00010000:0.0:1788390327.407934:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be971fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be971f4 expref: 15 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390327.407992:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390327.407999:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3622:x1875263097949312:12345-0@lo:103: 00010000:00010000:0.0:1788390327.408008:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390327.408012:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be971fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be971f4 expref: 15 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408023:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be971fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be971f4 expref: 15 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408035:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be971fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be971f4 expref: 15 pid: 6486 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408054:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408062:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408075:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408083:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408090:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408097:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408101:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390327.408105:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408112:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408141:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.408150:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390327.408190:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:3622:x1875263097949312:12345-0@lo:103: Request processed in 191us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.408203:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788390327.408268:0:6486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.408275:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.408282:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5ce600/0xe156d0713be9732f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788390327.408303:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788390327.408439:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097949312:0@lo:103: 00000100:00100000:1.0:1788390327.411405:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+13:8399:x1875263097948032:12345-0@lo:253: Request processed in 12192us (12472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.411419:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788390327.411551:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097948032:0@lo:253: 10000000:01000000:2.0:1788390327.411565:0:8399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788390327.411568:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788390327.411570:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788390327.411572:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390327.411573:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788390327.411574:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390327.411576:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390327.411577:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390327.411579:0:8399:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788390327.411580:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390327.411582:0:8399:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788390327.411602:0:8399:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984fb7b73800 from lustre-OST0000 10000000:01000000:2.0:1788390327.411643:0:8399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788390327.411647:0:8399:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788390327.411656:0:8399:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984f88c4cd28 local copy 10000000:01000000:2.0:1788390327.411660:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788390327.411694:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.411705:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.411716:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390327.411734:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949440:0@lo:101: 00000100:00100000:2.0:1788390327.411768:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.411801:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87952d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390327.411981:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097949440 00000100:00100000:0.0:1788390327.411988:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097949440 00000100:00100000:0.0:1788390327.412024:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788390327.412034:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+13:8399:x1875263097949440:12345-0@lo:101: 00010000:00010000:0.0:1788390327.412046:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390327.412059:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f80030400/0xe156d0713be9733d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97336 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.412083:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f80030400/0xe156d0713be9733d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97336 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.412093:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f80030400/0xe156d0713be9733d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97336 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.412103:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f80030400, rc 0) 00000100:00100000:0.0:1788390327.412152:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:8399:x1875263097949440:12345-0@lo:101: Request processed in 120us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.412159:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788390327.412270:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949440:0@lo:101: 00010000:00010000:3.0:1788390327.412283:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.412292:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390327.412420:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949568:0@lo:501: 00000100:00100000:3.0:1788390327.412448:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.412470:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.412526:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097949568 00000100:00100000:1.0:1788390327.412543:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097949568 00000100:00100000:1.0:1788390327.412565:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788390327.412572:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+14:8399:x1875263097949568:12345-0@lo:501: 00000100:00100000:1.0:1788390327.412649:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+14:8399:x1875263097949568:12345-0@lo:501: Request processed in 76us (199us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390327.412656:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788390327.412771:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949568:0@lo:501: 10000000:01000000:3.0:1788390327.412782:0:8399:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788390327.412801:0:8399:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788390327.412806:0:8399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.412814:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.412828:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.412853:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788390327.412876:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984fb7b73800 10000000:01000000:3.0:1788390327.412882:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788390327.412887:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788390327.412889:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390327.412894:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788390327.412896:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788390327.412911:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.412919:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.412926:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390327.412937:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949696:0@lo:101: 00000100:00100000:3.0:1788390327.412964:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.412987:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.413041:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097949696 00000100:00100000:2.0:1788390327.413045:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097949696 00000100:00100000:2.0:1788390327.413085:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788390327.413092:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+14:8399:x1875263097949696:12345-0@lo:101: 00010000:00010000:2.0:1788390327.413099:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390327.413108:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97344 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.413123:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97344 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.413145:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97344 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.413152:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cee00, rc 0) 00000100:00100000:2.0:1788390327.413181:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097949696:12345-0@lo:101: Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.413187:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788390327.413394:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949696:0@lo:101: 00010000:00010000:3.0:1788390327.413405:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.413414:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390327.413475:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949824:0@lo:501: 00000100:00100000:3.0:1788390327.413501:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.413517:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.413567:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097949824 00000100:00100000:2.0:1788390327.413571:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097949824 00000100:00100000:2.0:1788390327.413598:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788390327.413604:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097949824:12345-0@lo:501: 00000100:00100000:2.0:1788390327.413701:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097949824:12345-0@lo:501: Request processed in 96us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.413707:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788390327.413873:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949824:0@lo:501: 00000100:00100000:3.0:1788390327.413896:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949952:0@lo:503: 00000100:00100000:3.0:1788390327.413936:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.413956:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.414004:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097949952 00000100:00100000:2.0:1788390327.414008:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097949952 00000100:00100000:2.0:1788390327.414038:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788390327.414044:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097949952:12345-0@lo:503: 00000100:00100000:2.0:1788390327.414138:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097949952:12345-0@lo:503: Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.414152:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788390327.414224:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097949952:0@lo:503: 00000040:00080000:3.0:1788390327.414526:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390327.414596:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950080:0@lo:502: 00000100:00100000:3.0:1788390327.414645:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.414666:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390327.414842:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097950080 00000100:00100000:0.0:1788390327.414847:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097950080 00000100:00100000:0.0:1788390327.414884:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788390327.414892:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950080:12345-0@lo:502: 00000100:00100000:0.0:1788390327.414978:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950080:12345-0@lo:502: Request processed in 86us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.414985:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1788390327.415148:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390327.415155:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.415164:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfa00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390327.415168:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.415178:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390327.415185:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390327.415191:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390327.415215:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.415222:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390327.415254:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.415261:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be97336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe156d0713be9733d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.415296:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390327.415299:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390327.415301:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390327.415310:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390327.415340:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097950208:0@lo:103: 00000100:00100000:1.0:1788390327.415372:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.415408:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097950208 00000100:00100000:1.0:1788390327.415412:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097950208 00000100:00100000:1.0:1788390327.415440:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390327.415447:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3625:x1875263097950208:12345-0@lo:103: 00010000:00010000:1.0:1788390327.415458:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390327.415471:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80030400/0xe156d0713be9733d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97336 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.415483:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390327.415511:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+14:3625:x1875263097950208:12345-0@lo:103: Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.415517:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390327.415549:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097950208:0@lo:103: 00000100:00100000:3.0:1788390327.415831:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950080:0@lo:502: 00000040:00080000:3.0:1788390327.416049:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788390327.416079:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788390327.416095:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788390327.416109:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788390327.416122:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788390327.416149:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788390327.416172:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950336:0@lo:502: 00000100:00100000:3.0:1788390327.416210:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.416229:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390327.416285:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097950336 00000100:00100000:0.0:1788390327.416301:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097950336 00000100:00100000:0.0:1788390327.416374:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788390327.416381:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:8399:x1875263097950336:12345-0@lo:502: 00000100:00100000:0.0:1788390327.416458:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:8399:x1875263097950336:12345-0@lo:502: Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.416465:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788390327.416814:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950336:0@lo:502: 00000040:00080000:3.0:1788390327.416855:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788390327.416869:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788390327.417575:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788390327.417584:0:8423:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788390327.417591:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390327.417593:0:8423:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788390327.417599:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788390327.417614:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff984fb7b819b8) 00000020:00000080:1.0:1788390327.417705:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788390327.417715:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788390327.417790:0:8423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fb7b73800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788390327.417799:0:8423:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788390327.417807:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe156d0713be97359 00010000:00010000:1.0:1788390327.432310:0:8423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788390327.432954:0:8423:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788390327.440467:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 00010000:00010000:0.0:1788390327.441507:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1788390327.443532:0:8423:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788390327.451690:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788390327.451883:0:8423:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788390327.468038:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788390327.470855:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788390327.470869:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390327.470890:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390327.470892:0:8423:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788390327.470896:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390327.470901:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390327.470903:0:8423:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390327.470906:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390327.470908:0:8423:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788390327.470937:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390327.470940:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390327.470941:0:8423:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788390327.470944:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788390327.471157:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788390327.471186:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788390327.471214:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.471227:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390327.471236:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fb7b73800 from 1 10000000:01000000:1.0:1788390327.471239:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390327.471299:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.471308:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.471342:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.471366:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950464:0@lo:101: 00000100:00100000:1.0:1788390327.471438:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.471485:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f828b9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.474639:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097950464 00000100:00100000:2.0:1788390327.474655:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097950464 00000100:00100000:2.0:1788390327.474732:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788390327.474744:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+14:8399:x1875263097950464:12345-0@lo:101: 00010000:00010000:2.0:1788390327.474761:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390327.474780:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97360 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.474810:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97360 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.474821:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97360 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.474830:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfc00, rc 0) 00000100:00100000:2.0:1788390327.474921:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950464:12345-0@lo:101: Request processed in 179us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.474929:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788390327.475047:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950464:0@lo:101: 00010000:00010000:1.0:1788390327.475065:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.475074:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390327.475198:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950592:0@lo:501: 00000100:00100000:1.0:1788390327.475235:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.475271:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f828b9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.475965:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097950592 00000100:00100000:2.0:1788390327.475973:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097950592 00000100:00100000:2.0:1788390327.476053:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788390327.476063:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950592:12345-0@lo:501: 00000100:00100000:2.0:1788390327.476195:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950592:12345-0@lo:501: Request processed in 133us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.476201:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788390327.479989:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950592:0@lo:501: 00000100:00100000:2.0:1788390327.480058:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950720:0@lo:503: 00000100:00100000:2.0:1788390327.480123:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.480170:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.480281:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097950720 00000100:00100000:1.0:1788390327.480298:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097950720 00000100:00100000:1.0:1788390327.480364:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788390327.480373:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950720:12345-0@lo:503: 00000100:00100000:1.0:1788390327.480481:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950720:12345-0@lo:503: Request processed in 108us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.480488:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788390327.480644:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950720:0@lo:503: 00000040:00080000:2.0:1788390327.480901:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390327.480980:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950848:0@lo:502: 00000100:00100000:2.0:1788390327.481015:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.481042:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097950848 00000100:00100000:2.0:1788390327.481046:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097950848 00000100:00100000:2.0:1788390327.481081:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788390327.481089:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950848:12345-0@lo:502: 00000100:00100000:2.0:1788390327.481167:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950848:12345-0@lo:502: Request processed in 79us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.481174:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788390327.481209:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda180 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.481222:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950848:0@lo:502: 00000040:00080000:2.0:1788390327.482023:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788390327.482051:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788390327.482073:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950976:0@lo:502: 00000100:00100000:2.0:1788390327.482109:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.482180:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.483743:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097950976 00000100:00100000:1.0:1788390327.483754:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097950976 00000100:00100000:0.0:1788390327.483857:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788390327.483868:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950976:12345-0@lo:502: 00000100:00100000:0.0:1788390327.484022:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097950976:12345-0@lo:502: Request processed in 156us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390327.484030:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788390327.484180:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097950976:0@lo:502: 00000040:00080000:1.0:1788390327.484246:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788390327.484258:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788390327.484859:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390327.484869:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390327.484872:0:8427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788390327.484889:0:8427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fb7b73800 00000020:00000080:1.0:1788390327.484892:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390327.484907:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390327.484914:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390327.484915:0:8427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788390327.484918:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788390327.485051:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788390327.485071:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390327.485115:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.485146:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390327.485196:0:8399:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788390327.485200:0:8399:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984fb7b73800 10000000:01000000:2.0:1788390327.485203:0:8399:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984fb7b73800 10000000:01000000:2.0:1788390327.485209:0:8399:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788390327.485216:0:8399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fb7b73800 from 1 10000000:01000000:2.0:1788390327.485218:0:8399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788390327.485251:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.485258:0:8399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.485267:0:8399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390327.485284:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951104:0@lo:101: 00000100:00100000:2.0:1788390327.485369:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.485401:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.485515:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097951104 00000100:00100000:1.0:1788390327.485521:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097951104 00000100:00100000:1.0:1788390327.485561:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788390327.485570:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8399:x1875263097951104:12345-0@lo:101: 00010000:00010000:1.0:1788390327.485580:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390327.485594:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9736e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.485615:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9736e expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.485696:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9736e expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.485707:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cea00, rc 0) 00000100:00100000:1.0:1788390327.485742:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097951104:12345-0@lo:101: Request processed in 174us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.485749:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788390327.485824:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951104:0@lo:101: 00010000:00010000:2.0:1788390327.485838:0:8399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.485848:0:8399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390327.485950:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951232:0@lo:501: 00000100:00100000:2.0:1788390327.485975:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.485998:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.486091:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097951232 00000100:00100000:1.0:1788390327.486095:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097951232 00000100:00100000:1.0:1788390327.486125:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788390327.486143:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097951232:12345-0@lo:501: 00000100:00100000:1.0:1788390327.486233:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097951232:12345-0@lo:501: Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.486240:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788390327.487784:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951232:0@lo:501: 00000100:00100000:2.0:1788390327.487834:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951360:0@lo:503: 00000100:00100000:2.0:1788390327.488578:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.488612:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.489083:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097951360 00000100:00100000:1.0:1788390327.489102:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097951360 00000100:00100000:1.0:1788390327.489165:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788390327.489175:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097951360:12345-0@lo:503: 00000100:00100000:1.0:1788390327.489279:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097951360:12345-0@lo:503: Request processed in 106us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.489287:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788390327.492511:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951360:0@lo:503: 00000040:00080000:2.0:1788390327.492861:0:8399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390327.492985:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951488:0@lo:502: 00000100:00100000:2.0:1788390327.493057:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.493117:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097951488 00000100:00100000:2.0:1788390327.493125:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097951488 00000100:00100000:2.0:1788390327.493187:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788390327.493197:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097951488:12345-0@lo:502: 00000100:00100000:2.0:1788390327.493511:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097951488:12345-0@lo:502: Request processed in 315us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.493519:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788390327.493567:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.493585:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951488:0@lo:502: 00000040:00080000:2.0:1788390327.494033:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788390327.494062:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788390327.494077:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788390327.494091:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788390327.494116:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788390327.494154:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788390327.494170:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788390327.494184:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788390327.494198:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788390327.494212:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788390327.494228:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788390327.494241:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788390327.494252:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788390327.494265:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788390327.494278:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788390327.494518:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788390327.494541:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788390327.494556:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788390327.494571:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788390327.494584:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788390327.494599:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788390327.494706:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788390327.494727:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788390327.494743:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788390327.494759:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788390327.494775:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788390327.494791:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788390327.494806:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788390327.494820:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788390327.494834:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788390327.494849:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788390327.494864:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788390327.495437:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788390327.495462:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788390327.495478:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788390327.495492:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788390327.495507:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788390327.495574:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951616:0@lo:502: 00000100:00100000:3.0:1788390327.497035:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.497082:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390327.497143:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097951616 00000100:00100000:1.0:1788390327.497151:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097951616 00000100:00100000:1.0:1788390327.497209:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788390327.497219:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097951616:12345-0@lo:502: 00000100:00100000:1.0:1788390327.497393:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097951616:12345-0@lo:502: Request processed in 174us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390327.497400:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788390327.497710:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097951616:0@lo:502: 00000040:00080000:3.0:1788390327.497793:0:8399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788390327.497809:0:8399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788390327.498917:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788390327.498934:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff984fbaf80000) 00000020:00000080:3.0:1788390327.498954:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788390327.499066:0:8428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fb7b73800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788390327.499071:0:8428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fb7b73800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788390327.499076:0:8428:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fb7b73800 3 00010000:00080000:3.0:1788390327.499110:0:8428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e85f76000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.111@tcp at head 00010000:00010000:2.0:1788390327.504011:0:8428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788390327.506095:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788390327.506158:0:8428:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788390327.506173:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe156d0713be97383 00000100:00080000:2.0:1788390327.506185:0:8428:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390327.506191:0:8428:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff984e85f76000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390327.506231:0:8428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984fbb153100 x1875263097951744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788390327.506260:0:8428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1788390327.506507:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788390327.506524:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff984fbac099b8) 00000020:00000080:2.0:1788390327.506537:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788390327.506609:0:8428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fb7b73800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788390327.506614:0:8428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fb7b73800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788390327.506617:0:8428:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fb7b73800 3 00010000:00080000:2.0:1788390327.506659:0:8428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e85f3c800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.111@tcp at head 00010000:00010000:2.0:1788390327.508967:0:8428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:3.0:1788390327.509196:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097951872:0@lo:400: 00000100:00100000:3.0:1788390327.509264:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.509301:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390327.509308:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097952256:0@lo:400: 00000100:00100000:3.0:1788390327.509360:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.509394:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097952000:0@lo:400: 00000100:00100000:3.0:1788390327.509419:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.509437:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390327.509442:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097952128:0@lo:400: 00000100:00100000:3.0:1788390327.509463:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.509497:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097951872 00000100:00100000:3.0:1788390327.509505:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097951872 00000100:00100000:3.0:1788390327.509545:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097952128 00000100:00100000:3.0:1788390327.509549:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097952128 00000100:00100000:3.0:1788390327.509566:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390327.509574:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097951872:12345-0@lo:400: 00000100:00100000:3.0:1788390327.509628:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097951872:12345-0@lo:400: Request processed in 54us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.509636:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390327.509652:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390327.509658:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097952128:12345-0@lo:400: 00000100:00100000:3.0:1788390327.509688:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097952128:12345-0@lo:400: Request processed in 30us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.509694:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390327.509712:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097952256 00000100:00100000:3.0:1788390327.509715:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097952256 00000100:00100000:3.0:1788390327.509733:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097952000 00000100:00100000:3.0:1788390327.509736:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097952000 00000100:00100000:3.0:1788390327.509747:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390327.509752:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097952256:12345-0@lo:400: 00000100:00100000:3.0:1788390327.509782:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097952256:12345-0@lo:400: Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.509787:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390327.509798:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788390327.509804:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097952000:12345-0@lo:400: 00000100:00100000:3.0:1788390327.509828:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097952000:12345-0@lo:400: Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.509833:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788390327.509878:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097952256:0@lo:400: 00010000:00080000:3.0:1788390327.509892:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984f89f30e00 x1875263097951872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390327.509902:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097951872:0@lo:400: 00010000:00080000:3.0:1788390327.509941:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984f89f32d80 x1875263097952128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390327.509950:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097952128:0@lo:400: 00000100:00100000:3.0:1788390327.509959:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097952000:0@lo:400: 00000100:00100000:1.0:1788390327.511274:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1875263097951744:0@lo:38: 00000100:00100000:1.0:1788390327.511360:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.511511:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097951744 00000100:00100000:3.0:1788390327.511518:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097951744 00000100:00100000:3.0:1788390327.511555:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390327.511561:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263097951744:12345-0@lo:38: 00010000:00080000:3.0:1788390327.511585:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:3.0:1788390327.511620:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe156d0713be97391 00000004:00100000:3.0:1788390327.511947:0:6494:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788390327.511983:0:6494:0:(import.c:65:import_set_state_nolock()) ffff984e85f70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390327.512043:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875263097951744:12345-0@lo:38: Request processed in 480us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.512050:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788390327.512149:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb153100 x1875263097951744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390327.512160:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390327.512167:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788390327.512175:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788390327.512180:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788390327.512182:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e85f76000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788390327.512187:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1875263097951744:0@lo:38: 00000020:00000080:2.0:1788390327.516539:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788390327.516589:0:8428:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788390327.516604:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe156d0713be97398 00000100:00080000:2.0:1788390327.516616:0:8428:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390327.516675:0:8428:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff984e85f3c800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390327.516713:0:8428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984fbb151180 x1875263097952384/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788390327.516774:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1875263097952384:0@lo:38: 00000100:00100000:3.0:1788390327.516843:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788390327.516906:0:8428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788390327.519012:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097952384 00000100:00100000:2.0:1788390327.519027:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097952384 00000100:00100000:2.0:1788390327.519063:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390327.519071:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875263097952384:12345-0@lo:38: 00010000:00080000:2.0:1788390327.519097:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:2.0:1788390327.519151:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe156d0713be9739f 00000004:00100000:2.0:1788390327.519168:0:6493:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788390327.519202:0:6493:0:(import.c:65:import_set_state_nolock()) ffff984e85f3a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390327.523557:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875263097952384:12345-0@lo:38: Request processed in 4475us (6702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.523572:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1788390327.523838:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788390327.526422:0:8399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788390327.526473:0:8399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390327.526492:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390327.526513:0:8399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788390327.526570:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788390327.526572:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390327.526574:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390327.526575:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390327.526576:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390327.526577:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390327.526578:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390327.526580:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390327.526581:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390327.526583:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390327.526584:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390327.526587:0:8399:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788390327.526590:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390327.526591:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390327.526592:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390327.526593:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390327.526594:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390327.526595:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390327.526596:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390327.526597:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390327.526598:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390327.526599:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390327.526600:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390327.526945:0:8399:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788390327.526968:0:8399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097952512:0@lo:253: 00000100:00100000:1.0:1788390327.527035:0:8399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390327.527073:0:8399:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90682780 going to sleep for 11 seconds 00000100:00100000:2.0:1788390327.527432:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097952512 00000100:00100000:2.0:1788390327.527440:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097952512 00000100:00100000:2.0:1788390327.527488:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788390327.527497:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097952512:12345-0@lo:253: 20000000:01000000:2.0:1788390327.527525:0:6487:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788390327.527539:0:6487:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788390327.529457:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb151180 x1875263097952384/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390327.529473:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788390327.529485:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788390327.529494:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788390327.529500:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788390327.529504:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e85f3c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788390327.529511:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1875263097952384:0@lo:38: 20000000:01000000:2.0:1788390327.534496:0:6487:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788390327.534554:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788390327.534862:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:8399:x1875263097952512:12345-0@lo:253: Request processed in 7360us (7820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.534875:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788390327.534991:0:8399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:8399:1875263097952512:0@lo:253: 10000000:01000000:1.0:1788390327.535006:0:8399:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788390327.535009:0:8399:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788390327.535011:0:8399:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390327.535020:0:8399:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390327.535021:0:8399:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390327.535023:0:8399:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390327.535024:0:8399:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390327.535026:0:8399:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390327.535027:0:8399:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788390327.535029:0:8399:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788390327.535031:0:8399:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390327.535032:0:8399:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788390327.535048:0:8399:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788390327.537468:0:6508:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788390327.537479:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788390327.537509:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.537528:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5cf800/0xe156d0713be9729c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97295 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.537551:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf735a00/0xe156d0713be972b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972b1 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.537558:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.537602:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf735a00/0xe156d0713be972b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be972b1 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.537617:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf735a00/0xe156d0713be972b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be972b1 expref: 15 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390327.537702:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097952640:0@lo:104: 00000100:00100000:0.0:1788390327.537772:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390327.539178:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5cf800/0xe156d0713be9729c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97295 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390327.539193:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5cf800/0xe156d0713be9729c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97295 expref: 15 pid: 6486 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390327.539203:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097952768:0@lo:104: 00000100:00100000:0.0:1788390327.539238:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e8684fd80 going to sleep for 11 seconds 00080000:10000000:1.0:1788390327.540222:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788390327.540554:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788390327.540803:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788390327.540987:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788390327.541199:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00000100:00100000:2.0:1788390327.541405:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788390327.541441:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390327.541474:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097952640 00000100:00100000:2.0:1788390327.541482:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097952640 00000100:00100000:2.0:1788390327.541515:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097952768 00000100:00100000:2.0:1788390327.541517:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097952768 00000100:00100000:2.0:1788390327.541528:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390327.541543:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb0a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6508:x1875263097952640:12345-0@lo:104: 00010000:00010000:2.0:1788390327.541561:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be972b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541643:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390327.541649:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb0a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6508:x1875263097952640:12345-0@lo:104: Request processed in 107us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.541657:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390327.541694:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390327.541701:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6508:x1875263097952768:12345-0@lo:104: 00010000:00010000:2.0:1788390327.541708:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541738:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788390327.541743:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6508:x1875263097952768:12345-0@lo:104: Request processed in 43us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390327.541749:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390327.541783:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097952640:0@lo:104: 00000100:00100000:2.0:1788390327.541792:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097952768:0@lo:104: 00010000:00010000:2.0:1788390327.541811:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541827:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390327.541832:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be972b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541840:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce400 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390327.541844:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be972b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541858:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be972b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390327.541865:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be972b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390327.541870:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390327.541901:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be972b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541908:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390327.541926:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be972b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541932:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be972b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be972b8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541944:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390327.541947:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541952:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735600 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390327.541955:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541960:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390327.541966:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390327.541977:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390327.541992:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.541996:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390327.542010:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97295 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.542017:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9729c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390327.542033:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390327.542034:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390327.542036:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390327.542042:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390327.542418:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097952896:0@lo:103: 00000100:00100000:3.0:1788390327.542462:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.542516:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097953024:0@lo:103: 00000100:00100000:3.0:1788390327.542537:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.542571:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097952896 00000100:00100000:3.0:1788390327.542576:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097952896 00010000:00010000:3.0:1788390327.542601:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf735a00/0xe156d0713be972b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972b1 expref: 16 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390327.542680:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097953024 00000100:00100000:3.0:1788390327.542684:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097953024 00010000:00010000:3.0:1788390327.542698:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5cf800/0xe156d0713be9729c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97295 expref: 17 pid: 6486 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390327.542711:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390327.542718:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:3625:x1875263097952896:12345-0@lo:103: 00010000:00010000:3.0:1788390327.542728:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390327.542734:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf735a00/0xe156d0713be972b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972b1 expref: 17 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542745:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf735a00/0xe156d0713be972b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be972b1 expref: 17 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542759:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf735a00/0xe156d0713be972b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be972b1 expref: 17 pid: 6484 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542773:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390327.542800:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:3625:x1875263097952896:12345-0@lo:103: Request processed in 83us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.542815:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390327.542829:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390327.542834:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3622:x1875263097953024:12345-0@lo:103: 00010000:00010000:3.0:1788390327.542841:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390327.542845:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5cf800/0xe156d0713be9729c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97295 expref: 15 pid: 6486 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542854:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5cf800/0xe156d0713be9729c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97295 expref: 15 pid: 6486 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542864:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cf800/0xe156d0713be9729c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97295 expref: 15 pid: 6486 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542876:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542884:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788390327.542898:0:6479:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005419288s 00010000:00010000:3.0:1788390327.542903:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542910:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542916:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542923:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542936:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80031e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390327.542940:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542947:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542963:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.542973:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390327.542997:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+14:3622:x1875263097953024:12345-0@lo:103: Request processed in 162us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.543003:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390327.543030:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097952896:0@lo:103: 00000100:00100000:3.0:1788390327.543046:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097953024:0@lo:103: 00010000:00010000:3.0:1788390327.543058:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.543066:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390327.543073:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80031e00/0xe156d0713be973a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788390327.543780:0:8399:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788390327.550726:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788390327.558146:0:8399:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788390327.558155:0:8399:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788390327.558195:0:8399:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788390327.558244:0:8399:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788390327.558271:0:8399:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788390327.558417:0:8399:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788390327.559266:0:8399:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788390327.559487:0:8399:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788390327.894897:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390327.894927:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097953152:0@lo:41: 00000100:00100000:3.0:1788390327.894999:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390327.895082:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097953152 00000100:00100000:3.0:1788390327.895090:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097953152 00000100:00100000:3.0:1788390327.895154:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390327.895165:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097953152:12345-0@lo:41: 00000004:00000024:3.0:1788390327.895202:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788390327.895251:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097953152:12345-0@lo:41: Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390327.895259:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390327.895307:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097953152:0@lo:41: 00010000:00010000:2.0:1788390328.469973:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788390328.700075:0:8484:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390328.701220:0:8484:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788390329.489468:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390329.937692:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097953280:0@lo:41: 00000100:00100000:3.0:1788390329.937770:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390329.937900:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097953280 00000100:00100000:2.0:1788390329.937910:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097953280 00000100:00100000:2.0:1788390329.937960:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788390329.937971:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097953280:12345-0@lo:41: 00000004:00000024:2.0:1788390329.938002:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788390329.938051:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097953280:12345-0@lo:41: Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390329.938058:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788390329.938100:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097953280:0@lo:41: 00010000:00010000:2.0:1788390330.518565:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390331.537500:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390332.565774:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390333.013829:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097953536:0@lo:400: 00000100:00100000:0.0:1788390333.013944:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390333.013998:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263097954048:0@lo:400: 00000100:00100000:0.0:1788390333.014022:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390333.014064:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788390333.014070:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097953664:0@lo:400: 00000100:00100000:0.0:1788390333.014117:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390333.014135:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263097954176:0@lo:400: 00000100:00100000:0.0:1788390333.014155:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390333.014187:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097953536 00000100:00100000:0.0:1788390333.014195:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097953536 00000100:00100000:0.0:1788390333.014232:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097954048 00000100:00100000:0.0:1788390333.014234:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097954048 00000100:00100000:0.0:1788390333.014263:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097954176 00000100:00100000:0.0:1788390333.014265:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097954176 00000100:00100000:0.0:1788390333.014280:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390333.014288:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097953536:12345-0@lo:400: 00000100:00100000:0.0:1788390333.014354:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097953536:12345-0@lo:400: Request processed in 67us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.014361:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390333.014380:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390333.014386:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263097954048:12345-0@lo:400: 00000100:00100000:0.0:1788390333.014408:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263097954048:12345-0@lo:400: Request processed in 23us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.014415:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390333.014424:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390333.014429:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263097954176:12345-0@lo:400: 00000100:00100000:0.0:1788390333.014462:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263097954176:12345-0@lo:400: Request processed in 33us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.014468:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390333.014485:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097953664 00000100:00100000:0.0:1788390333.014488:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097953664 00000100:00100000:0.0:1788390333.014514:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390333.014519:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097953664:12345-0@lo:400: 00000100:00100000:0.0:1788390333.014546:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097953664:12345-0@lo:400: Request processed in 27us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.014551:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390333.014582:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097953664:0@lo:400: 00010000:00080000:0.0:1788390333.014594:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e1880 x1875263097954176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390333.014604:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263097954176:0@lo:400: 00010000:00080000:0.0:1788390333.014612:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e1c00 x1875263097953536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390333.014621:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097953536:0@lo:400: 00010000:00080000:0.0:1788390333.014629:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e3480 x1875263097954048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390333.014637:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263097954048:0@lo:400: 00000100:00100000:2.0:1788390333.014848:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097953408:0@lo:400: 00000100:00100000:2.0:1788390333.014884:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390333.014918:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097953920:0@lo:400: 00000100:00100000:2.0:1788390333.014939:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390333.014956:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390333.014962:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263097953792:0@lo:400: 00000100:00100000:2.0:1788390333.014979:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390333.015004:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097953792 00000100:00100000:2.0:1788390333.015008:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097953792 00000100:00100000:2.0:1788390333.015027:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390333.015033:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263097953792:12345-0@lo:400: 00000100:00100000:2.0:1788390333.015064:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263097953792:12345-0@lo:400: Request processed in 32us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390333.015070:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390333.015101:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097953920 00000100:00100000:2.0:1788390333.015104:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097953920 00000100:00100000:2.0:1788390333.015124:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788390333.015129:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097953920:12345-0@lo:400: 00000100:00100000:2.0:1788390333.015155:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097953920:12345-0@lo:400: Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390333.015161:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788390333.015186:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e1f80 x1875263097953792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390333.015196:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263097953792:0@lo:400: 00000100:00100000:2.0:1788390333.015204:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097953920:0@lo:400: 00000100:00100000:0.0:1788390333.015403:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097953408 00000100:00100000:0.0:1788390333.015408:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097953408 00000100:00100000:0.0:1788390333.015447:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788390333.015454:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:3625:x1875263097953408:12345-0@lo:400: 00000100:00100000:0.0:1788390333.015484:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:3625:x1875263097953408:12345-0@lo:400: Request processed in 31us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.015490:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788390333.015656:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097953408:0@lo:400: 00000100:00080000:1.0:1788390333.015761:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390333.015771:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390333.018347:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390333.018376:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097954304:0@lo:41: 00000100:00100000:0.0:1788390333.018467:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390333.018531:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097954304 00000100:00100000:0.0:1788390333.018803:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097954304 00000100:00100000:0.0:1788390333.018852:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788390333.018861:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097954304:12345-0@lo:41: 00000004:00000024:0.0:1788390333.018894:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788390333.018938:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097954304:12345-0@lo:41: Request processed in 78us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390333.018946:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788390333.018999:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097954304:0@lo:41: 00010000:00010000:2.0:1788390333.585514:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390334.406748:0:8774:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1788390334.545779:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788390334.545786:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fb76a1000 from 30 10000000:01000000:0.0:1788390334.545793:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788390334.545840:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390334.545853:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390334.545865:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390334.545888:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097954432:0@lo:101: 00000100:00100000:0.0:1788390334.545957:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.546007:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1e2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.546061:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097954432 00000100:00100000:2.0:1788390334.546076:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097954432 00000100:00100000:2.0:1788390334.546134:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788390334.546144:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+14:6489:x1875263097954432:12345-0@lo:101: 00010000:00010000:2.0:1788390334.546160:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390334.546174:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be973ad expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.546198:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be973ad expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.546209:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be973ad expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.546217:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cec00, rc 0) 00000100:00100000:2.0:1788390334.546266:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097954432:12345-0@lo:101: Request processed in 124us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.546273:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788390334.546919:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097954432:0@lo:101: 00010000:00010000:2.0:1788390334.546936:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.546946:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390334.547011:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097954560:0@lo:501: 00000100:00100000:2.0:1788390334.547054:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.547088:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.547102:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097954560 00000100:00100000:2.0:1788390334.547107:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097954560 00000100:00100000:2.0:1788390334.547133:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788390334.547140:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097954560:12345-0@lo:501: 00000100:00100000:2.0:1788390334.547256:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097954560:12345-0@lo:501: Request processed in 115us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.547262:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788390334.547291:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097954560:0@lo:501: 00000100:00100000:2.0:1788390334.547314:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097954688:0@lo:503: 00000100:00100000:2.0:1788390334.547368:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.547381:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.547391:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097954688 00000100:00100000:2.0:1788390334.547395:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097954688 00000100:00100000:2.0:1788390334.547414:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788390334.547420:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097954688:12345-0@lo:503: 00000100:00100000:2.0:1788390334.547493:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097954688:12345-0@lo:503: Request processed in 72us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.547499:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788390334.547536:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097954688:0@lo:503: 00000100:00100000:2.0:1788390334.547744:0:8782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8782:1875263097954816:0@lo:502: 00000100:00100000:2.0:1788390334.547776:0:8782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.547793:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097954816 00000100:00100000:2.0:1788390334.547796:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097954816 00000100:00100000:2.0:1788390334.547816:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788390334.547828:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8782:x1875263097954816:12345-0@lo:502: 00000100:00100000:2.0:1788390334.547895:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8782:x1875263097954816:12345-0@lo:502: Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.547902:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788390334.547928:0:8782:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.547939:0:8782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8782:1875263097954816:0@lo:502: 00000100:00100000:2.0:1788390334.547974:0:8782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8782:1875263097954944:0@lo:502: 00000100:00100000:2.0:1788390334.548005:0:8782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.548022:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097954944 00000100:00100000:2.0:1788390334.548025:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097954944 00000100:00100000:2.0:1788390334.548045:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788390334.548051:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8782:x1875263097954944:12345-0@lo:502: 00000100:00100000:2.0:1788390334.548113:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:8782:x1875263097954944:12345-0@lo:502: Request processed in 61us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.548119:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788390334.548144:0:8782:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.548154:0:8782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8782:1875263097954944:0@lo:502: 00000040:00080000:2.0:1788390334.548170:0:8782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788390334.548217:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788390334.548234:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788390334.548242:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548249:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390334.548257:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788390334.548265:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984fb76a1000 from 5 10000000:01000000:2.0:1788390334.548268:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788390334.548289:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548297:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548306:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390334.548317:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955072:0@lo:101: 00000100:00100000:2.0:1788390334.548363:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.548376:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.548387:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097955072 00000100:00100000:2.0:1788390334.548390:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097955072 00000100:00100000:2.0:1788390334.548410:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788390334.548416:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097955072:12345-0@lo:101: 00010000:00010000:2.0:1788390334.548424:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390334.548434:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be973bb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548447:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be973bb expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548455:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be973bb expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548463:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf200, rc 0) 00000100:00100000:2.0:1788390334.548486:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097955072:12345-0@lo:101: Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.548495:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788390334.548521:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955072:0@lo:101: 00010000:00010000:2.0:1788390334.548530:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548536:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390334.548570:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955200:0@lo:256: 00000100:00100000:2.0:1788390334.548593:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.548602:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.548611:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097955200 00000100:00100000:2.0:1788390334.548614:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097955200 00000100:00100000:2.0:1788390334.548629:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788390334.548634:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097955200:12345-0@lo:256: 20000000:01000000:2.0:1788390334.548643:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788390334.548659:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788390334.548661:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788390334.548720:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097955200:12345-0@lo:256: Request processed in 85us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.548725:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788390334.548749:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955200:0@lo:256: 10000000:01000000:2.0:1788390334.548780:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788390334.548784:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548790:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390334.548799:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788390334.548801:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1788390334.548803:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788390334.548815:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548820:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548826:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390334.548837:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955328:0@lo:101: 00000100:00100000:2.0:1788390334.548858:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.548867:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.548876:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097955328 00000100:00100000:2.0:1788390334.548879:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097955328 00000100:00100000:2.0:1788390334.548894:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788390334.548898:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097955328:12345-0@lo:101: 00010000:00010000:2.0:1788390334.548904:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390334.548911:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be973c9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548922:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be973c9 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548930:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be973c9 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.548945:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfa00, rc 0) 00000100:00100000:2.0:1788390334.548966:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097955328:12345-0@lo:101: Request processed in 67us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.548971:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788390334.548994:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955328:0@lo:101: 00010000:00010000:2.0:1788390334.549002:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.549011:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390334.549043:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955456:0@lo:501: 00000100:00100000:2.0:1788390334.549076:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.549088:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.549097:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097955456 00000100:00100000:2.0:1788390334.549100:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097955456 00000100:00100000:2.0:1788390334.549118:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788390334.549124:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097955456:12345-0@lo:501: 00000100:00100000:2.0:1788390334.549201:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097955456:12345-0@lo:501: Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.549207:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788390334.549230:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955456:0@lo:501: 00000100:00100000:2.0:1788390334.549249:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955584:0@lo:503: 00000100:00100000:2.0:1788390334.549277:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.549287:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.549299:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097955584 00000100:00100000:2.0:1788390334.549302:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097955584 00000100:00100000:2.0:1788390334.549318:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788390334.549343:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097955584:12345-0@lo:503: 00000100:00100000:2.0:1788390334.549400:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097955584:12345-0@lo:503: Request processed in 58us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.549405:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788390334.549435:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097955584:0@lo:503: 00000100:00100000:3.0:1788390334.551843:0:8783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8783:1875263097955712:0@lo:502: 00000100:00100000:3.0:1788390334.551913:0:8783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.551958:0:8783:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f8299d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390334.552004:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097955712 00000100:00100000:0.0:1788390334.552012:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097955712 00000100:00100000:0.0:1788390334.552071:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788390334.552081:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:8783:x1875263097955712:12345-0@lo:502: 00000100:00100000:0.0:1788390334.552196:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:8783:x1875263097955712:12345-0@lo:502: Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390334.552209:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788390334.553636:0:8783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8783:1875263097955712:0@lo:502: 00000020:01000000:3.0:1788390334.553670:0:8783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390334.553678:0:8783:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788390334.553685:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390334.553688:0:8783:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788390334.553691:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788390334.553695:0:8783:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:01000000:3.0:1788390334.553717:0:8783:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788390334.553719:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390334.553734:0:8783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff984fbaf819b8) 00000020:00000080:3.0:1788390334.553754:0:8783:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788390334.553758:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788390334.553838:0:8783:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788390334.553847:0:8783:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788390334.553854:0:8783:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be973de 00010000:00080000:3.0:1788390334.553879:0:8783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984f89f61800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.111@tcp at head 00010000:00010000:3.0:1788390334.554088:0:8783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788390334.577909:0:8783:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788390334.577932:0:8783:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788390334.578148:0:8783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390334.578370:0:8783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390334.578466:0:8783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788390334.578543:0:8783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788390334.578975:0:8786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390334.578980:0:8786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788390334.593421:0:8783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788390334.593436:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788390334.593482:0:8783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788390334.593506:0:8783:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be973e5 00000100:00080000:0.0:1788390334.593519:0:8783:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390334.593524:0:8783:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff984f89f61800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390334.593558:0:8783:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984fb76e1880 x1875263097955840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788390334.596909:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263097955840:0@lo:8: 00000100:00100000:3.0:1788390334.597013:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390334.597116:0:8783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788390334.597262:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097955968:0@lo:400: 00000100:00100000:0.0:1788390334.597297:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.597364:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263097956480:0@lo:400: 00000100:00100000:0.0:1788390334.597390:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.597416:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390334.597421:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097956352:0@lo:400: 00000100:00100000:0.0:1788390334.597443:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.597466:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097956096:0@lo:400: 00000100:00100000:0.0:1788390334.597484:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.597499:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263097956608:0@lo:400: 00000100:00100000:0.0:1788390334.597516:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.597531:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390334.597535:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097956224:0@lo:400: 00000100:00100000:0.0:1788390334.597557:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.597817:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097956352 00000100:00100000:0.0:1788390334.597836:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097956352 00000100:00100000:0.0:1788390334.597891:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097956096 00000100:00100000:0.0:1788390334.597894:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097956096 00000100:00100000:0.0:1788390334.597911:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788390334.597920:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097956352:12345-0@lo:400: 00000100:00100000:0.0:1788390334.597976:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097956352:12345-0@lo:400: Request processed in 56us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390334.597983:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788390334.598003:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788390334.598010:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097956096:12345-0@lo:400: 00000100:00100000:1.0:1788390334.598142:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097955840 00000100:00100000:1.0:1788390334.598147:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097955840 00000100:00100000:1.0:1788390334.598171:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390334.598176:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1875263097955840:12345-0@lo:8: 00010000:00080000:1.0:1788390334.598203:0:8407:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:1.0:1788390334.598239:0:8407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be973ec 00002000:00100000:1.0:1788390334.598290:0:8407:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff984fbb3bb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788390334.598295:0:8407:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788390334.598299:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788390334.598405:0:8407:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788390334.598784:0:8407:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788390334.598812:0:8407:0:(import.c:65:import_set_state_nolock()) ffff984fbb3ba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390334.598927:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097956096:12345-0@lo:400: Request processed in 915us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390334.598935:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788390334.598983:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097956096:0@lo:400: 00000100:00100000:0.0:1788390334.599014:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097956352:0@lo:400: 00000020:01000000:0.0:1788390334.599123:0:8783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390334.599130:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390334.599132:0:8783:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788390334.599135:0:8783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390334.599140:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390334.599141:0:8783:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390334.599144:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390334.599146:0:8783:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788390334.599173:0:8783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8783:1875263097956736:0@lo:502: 00000100:00100000:0.0:1788390334.599216:0:8783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.599242:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097956736 00000100:00100000:0.0:1788390334.599246:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097956736 00000100:00100000:0.0:1788390334.599276:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390334.599282:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:8783:x1875263097956736:12345-0@lo:502: 00000100:00100000:2.0:1788390334.605273:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097955968 00000100:00100000:2.0:1788390334.605288:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097955968 00000100:00100000:2.0:1788390334.605382:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097956480 00000100:00100000:2.0:1788390334.605386:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097956480 00000100:00100000:2.0:1788390334.605399:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097956608 00000100:00100000:2.0:1788390334.605401:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097956608 00000100:00100000:2.0:1788390334.605410:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097956224 00000100:00100000:2.0:1788390334.605413:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097956224 00000100:00100000:2.0:1788390334.605428:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390334.605437:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097955968:12345-0@lo:400: 00000100:00100000:2.0:1788390334.605546:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097955968:12345-0@lo:400: Request processed in 110us (8247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.605554:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390334.605570:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788390334.605576:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263097956480:12345-0@lo:400: 00000100:00100000:2.0:1788390334.605601:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263097956480:12345-0@lo:400: Request processed in 26us (8211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.605607:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788390334.605617:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788390334.605622:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263097956608:12345-0@lo:400: 00000100:00100000:2.0:1788390334.605667:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263097956608:12345-0@lo:400: Request processed in 45us (8150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.605673:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788390334.605684:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788390334.605690:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097956224:12345-0@lo:400: 00000100:00100000:2.0:1788390334.605713:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097956224:12345-0@lo:400: Request processed in 24us (8156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.605718:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788390334.605776:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e2300 x1875263097956224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.605792:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097956224:0@lo:400: 00010000:00080000:2.0:1788390334.605808:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16e300 x1875263097956608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.605817:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263097956608:0@lo:400: 00010000:00080000:2.0:1788390334.605855:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e3b80 x1875263097955968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.605865:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097955968:0@lo:400: 00010000:00080000:2.0:1788390334.605879:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e1f80 x1875263097956480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.605887:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263097956480:0@lo:400: 00000100:00100000:0.0:1788390334.607209:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:8783:x1875263097956736:12345-0@lo:502: Request processed in 7920us (7985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390334.607221:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390334.607398:0:8783:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1e2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390334.607418:0:8783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8783:1875263097956736:0@lo:502: 00000020:01000000:0.0:1788390334.607448:0:8783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390334.607456:0:8783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390334.607458:0:8783:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788390334.607463:0:8783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788390334.607525:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788390334.607542:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788390334.607551:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390334.607562:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390334.607573:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788390334.607575:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984f988e6800 from 30 10000000:01000000:0.0:1788390334.607578:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788390334.607609:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390334.607617:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390334.607627:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390334.607644:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097956864:0@lo:101: 00000100:00100000:0.0:1788390334.607685:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.607706:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1e2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390334.608426:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097956864 00000100:00100000:3.0:1788390334.608435:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097956864 00000100:00100000:3.0:1788390334.608479:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788390334.608488:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097956864:12345-0@lo:101: 00010000:00010000:3.0:1788390334.608501:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390334.608514:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be973f3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.608536:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be973f3 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.608546:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be973f3 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.608555:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735a00, rc 0) 00000100:00100000:3.0:1788390334.608613:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097956864:12345-0@lo:101: Request processed in 127us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.608620:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788390334.608663:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097956864:0@lo:101: 00010000:00010000:3.0:1788390334.608675:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.608685:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390334.608744:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097956992:0@lo:501: 00000100:00100000:3.0:1788390334.608772:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.608788:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87952cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390334.608800:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097956992 00000100:00100000:3.0:1788390334.608804:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097956992 00000100:00100000:3.0:1788390334.608825:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788390334.608831:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097956992:12345-0@lo:501: 00000100:00100000:3.0:1788390334.608934:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097956992:12345-0@lo:501: Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.608940:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788390334.608970:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097956992:0@lo:501: 00000100:00100000:3.0:1788390334.608996:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097957120:0@lo:503: 00000100:00100000:3.0:1788390334.609401:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.609414:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87952cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390334.609424:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097957120 00000100:00100000:3.0:1788390334.609427:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097957120 00000100:00100000:3.0:1788390334.609445:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788390334.609450:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097957120:12345-0@lo:503: 00000100:00100000:3.0:1788390334.609519:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097957120:12345-0@lo:503: Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.609531:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788390334.609655:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097957120:0@lo:503: 00000100:00100000:1.0:1788390334.610154:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1875263097955840:12345-0@lo:8: Request processed in 11972us (13136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390334.610165:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788390334.611590:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e1880 x1875263097955840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390334.611605:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788390334.611618:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788390334.611626:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788390334.611632:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788390334.611636:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f89f61800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788390334.611651:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788390334.611656:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263097955840:0@lo:8: 00000004:00080000:1.0:1788390334.611880:0:8786:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788390334.611961:0:8786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 155169638661ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788390334.611967:0:8786:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788390334.612120:0:8789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8789:1875263097957248:0@lo:502: 00000100:00100000:1.0:1788390334.612205:0:8789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390334.612238:0:8789:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f831d9780 going to sleep for 11 seconds 00010000:00010000:0.0:1788390334.613393:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390334.613452:0:8787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8787:1875263097957376:0@lo:700: 00000100:00100000:0.0:1788390334.613510:0:8787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.613543:0:8787:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390334.616735:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097957376 00000100:00100000:0.0:1788390334.616752:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097957376 00000100:00100000:0.0:1788390334.616834:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390334.616846:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8787:x1875263097957376:12345-0@lo:700: 00000100:00100000:0.0:1788390334.616909:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8415:1875263097957504:0@lo:700: 00000100:00100000:0.0:1788390334.616977:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.617004:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1e2480 going to sleep for 11 seconds 00000100:00080000:1.0:1788390334.617443:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390334.619249:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097957248 00000100:00100000:3.0:1788390334.619262:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097957248 00000100:00100000:3.0:1788390334.619718:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788390334.619732:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:8789:x1875263097957248:12345-0@lo:502: 00000100:00100000:3.0:1788390334.619912:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:8789:x1875263097957248:12345-0@lo:502: Request processed in 183us (7707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.619920:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788390334.625860:0:8789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8789:1875263097957248:0@lo:502: 00000100:00100000:0.0:1788390334.625970:0:8789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8789:1875263097957632:0@lo:502: 00000100:00100000:0.0:1788390334.626049:0:8789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.626112:0:8789:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1e2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390334.626353:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097957632 00000100:00100000:3.0:1788390334.626362:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097957632 00000100:00100000:3.0:1788390334.626415:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788390334.626424:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:8789:x1875263097957632:12345-0@lo:502: 00000100:00100000:3.0:1788390334.626549:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:8789:x1875263097957632:12345-0@lo:502: Request processed in 125us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.626556:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788390334.626792:0:8789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8789:1875263097957632:0@lo:502: 00000040:00080000:0.0:1788390334.626816:0:8789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788390334.627147:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788390334.627173:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788390334.627183:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.627193:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390334.627202:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390334.627205:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984f988e6800 from 5 10000000:01000000:3.0:1788390334.627208:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390334.627234:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.627242:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.627251:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390334.627268:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097957760:0@lo:101: 00000100:00100000:3.0:1788390334.627300:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.627343:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1ab900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390334.627529:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097957760 00000100:00100000:0.0:1788390334.627534:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097957760 00000100:00100000:0.0:1788390334.627577:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788390334.627583:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097957760:12345-0@lo:101: 00010000:00010000:0.0:1788390334.627592:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390334.627603:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97401 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390334.627636:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97401 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390334.627644:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97401 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390334.627655:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f80030a00, rc 0) 00000100:00100000:0.0:1788390334.627686:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097957760:12345-0@lo:101: Request processed in 102us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390334.627690:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788390334.629280:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097957760:0@lo:101: 00010000:00010000:3.0:1788390334.629302:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.629312:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390334.629396:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097957888:0@lo:256: 00000100:00100000:3.0:1788390334.629454:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.629491:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1ab900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390334.629748:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097957888 00000100:00100000:1.0:1788390334.629755:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097957888 00000100:00100000:1.0:1788390334.629801:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788390334.629811:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097957888:12345-0@lo:256: 20000000:01000000:1.0:1788390334.629829:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788390334.629845:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788390334.629848:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788390334.629934:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097957888:12345-0@lo:256: Request processed in 124us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390334.629943:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788390334.630154:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097957888:0@lo:256: 10000000:01000000:3.0:1788390334.630193:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390334.630200:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.630208:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390334.630216:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788390334.630218:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788390334.630221:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788390334.630244:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.630249:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.630257:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390334.630267:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958016:0@lo:101: 00000100:00100000:3.0:1788390334.630291:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.630313:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1ab900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390334.630343:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097958016 00000100:00100000:3.0:1788390334.630351:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097958016 00000100:00100000:3.0:1788390334.630374:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788390334.630379:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097958016:12345-0@lo:101: 00010000:00010000:3.0:1788390334.630386:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390334.630397:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9740f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.630413:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9740f expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.630421:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9740f expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.630430:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf734c00, rc 0) 00000100:00100000:3.0:1788390334.630454:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097958016:12345-0@lo:101: Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.630460:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788390334.630482:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958016:0@lo:101: 00010000:00010000:3.0:1788390334.630492:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.630499:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390334.630543:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958144:0@lo:501: 00000004:00080000:1.0:1788390334.630748:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788390334.631957:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097957504 00000100:00100000:2.0:1788390334.631965:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097957504 00000100:00100000:2.0:1788390334.632003:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390334.632011:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8415:x1875263097957504:12345-0@lo:700: 00000100:00100000:3.0:1788390334.632651:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.632705:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1ab900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390334.632812:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097958144 00000100:00100000:1.0:1788390334.632817:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097958144 00000100:00100000:1.0:1788390334.632854:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788390334.632861:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097958144:12345-0@lo:501: 00000100:00100000:1.0:1788390334.632993:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097958144:12345-0@lo:501: Request processed in 132us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390334.633001:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788390334.633158:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958144:0@lo:501: 00000100:00100000:3.0:1788390334.633207:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958272:0@lo:503: 00000100:00100000:3.0:1788390334.633245:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.633270:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.633416:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097958272 00000100:00100000:2.0:1788390334.633421:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097958272 00000100:00100000:2.0:1788390334.633443:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788390334.633449:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097958272:12345-0@lo:503: 00000100:00100000:2.0:1788390334.633520:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097958272:12345-0@lo:503: Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.633526:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788390334.634207:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958272:0@lo:503: 00000100:00100000:2.0:1788390334.635820:0:8791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8791:1875263097958400:0@lo:502: 00000100:00100000:2.0:1788390334.635904:0:8791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.635945:0:8791:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390334.638557:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097958400 00000100:00100000:1.0:1788390334.638573:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097958400 00000100:00100000:1.0:1788390334.638629:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788390334.638638:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:8791:x1875263097958400:12345-0@lo:502: 00000100:00100000:1.0:1788390334.638805:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:8791:x1875263097958400:12345-0@lo:502: Request processed in 168us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390334.638812:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788390334.639051:0:8791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8791:1875263097958400:0@lo:502: 00000020:01000000:3.0:1788390334.639102:0:8791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390334.639110:0:8791:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788390334.639118:0:8791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390334.639120:0:8791:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788390334.639126:0:8791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788390334.639130:0:8791:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:01000000:3.0:1788390334.639158:0:8791:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788390334.639161:0:8791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390334.639181:0:8791:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff984fbaf83370) 00000020:00000080:3.0:1788390334.639204:0:8791:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788390334.639209:0:8791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788390334.639353:0:8791:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788390334.639359:0:8791:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788390334.639366:0:8791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be97424 00010000:00080000:3.0:1788390334.639399:0:8791:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984f88c45000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.111@tcp at head 00010000:00010000:3.0:1788390334.639833:0:8791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:2.0:1788390334.642911:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:3.0:1788390334.647470:0:8791:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788390334.647497:0:8791:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788390334.647724:0:8791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390334.647930:0:8791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390334.648024:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788390334.648131:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788390334.649554:0:8792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788390334.649568:0:8792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788390334.650710:0:8791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390334.650727:0:8791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788390334.650766:0:8791:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788390334.650790:0:8791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be9742b 00000100:00080000:3.0:1788390334.650801:0:8791:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390334.650808:0:8791:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff984f88c45000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390334.650850:0:8791:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984fbb21a680 x1875263097958528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390334.650904:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263097958528:0@lo:8: 00000100:00100000:1.0:1788390334.650969:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.651057:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097958528 00000100:00100000:3.0:1788390334.651072:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097958528 00000100:00100000:3.0:1788390334.651101:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390334.651108:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3621:x1875263097958528:12345-0@lo:8: 00010000:00080000:3.0:1788390334.651132:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:3.0:1788390334.651156:0:8409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be97432 00002000:00100000:3.0:1788390334.651169:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff984f88c41800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788390334.651173:0:8409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788390334.651175:0:8409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788390334.651239:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788390334.651270:0:8409:0:(import.c:65:import_set_state_nolock()) ffff984fc18fd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390334.654527:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8415:x1875263097957504:12345-0@lo:700: Request processed in 22506us (37540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.654542:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788390334.656469:0:8415:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16ca80 x1875263097957504/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.656487:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8415:1875263097957504:0@lo:700: 40000000:02000000:2.0:1788390334.656503:0:8415:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00080000:1.0:1788390334.666767:0:8791:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788390334.666890:0:8791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390334.666897:0:8791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390334.666900:0:8791:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788390334.666904:0:8791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390334.666908:0:8791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390334.666910:0:8791:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788390334.666913:0:8791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788390334.666915:0:8791:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788390334.666959:0:8791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8791:1875263097958656:0@lo:502: 00000100:00100000:1.0:1788390334.667046:0:8791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390334.667094:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097958656 00000100:00100000:1.0:1788390334.667103:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097958656 00000100:00100000:1.0:1788390334.667158:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788390334.667640:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+20:8791:x1875263097958656:12345-0@lo:502: 00000100:00100000:1.0:1788390334.667757:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+20:8791:x1875263097958656:12345-0@lo:502: Request processed in 122us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390334.667765:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788390334.667819:0:8791:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390334.667840:0:8791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:8791:1875263097958656:0@lo:502: 00000020:01000000:1.0:1788390334.667869:0:8791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390334.667875:0:8791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390334.667876:0:8791:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788390334.667880:0:8791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1788390334.668262:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875263097958528:12345-0@lo:8: Request processed in 17151us (17291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.668271:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:3.0:1788390334.668311:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788390334.668357:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788390334.668366:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.668377:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390334.668395:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788390334.668398:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984f88c4cd28 from 1 10000000:01000000:3.0:1788390334.668400:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788390334.668426:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.668433:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390334.668442:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390334.668455:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958784:0@lo:101: 00000100:00100000:3.0:1788390334.668484:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.668506:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1abe40 going to sleep for 11 seconds 00010000:00080000:3.0:1788390334.668532:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb21a680 x1875263097958528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390334.668542:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788390334.668549:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788390334.668555:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788390334.670746:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788390334.670756:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f88c45000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788390334.670771:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788390334.670781:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263097958528:0@lo:8: 00000100:00100000:2.0:1788390334.671769:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097958784 00000100:00100000:2.0:1788390334.671780:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097958784 00000100:00100000:2.0:1788390334.671834:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788390334.671844:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097958784:12345-0@lo:101: 00010000:00010000:2.0:1788390334.671862:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390334.671880:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97439 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.671917:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97439 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.671929:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97439 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.671938:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20ce400, rc 0) 00000100:00100000:2.0:1788390334.672013:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097958784:12345-0@lo:101: Request processed in 169us (3526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.672020:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788390334.672432:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958784:0@lo:101: 00010000:00010000:2.0:1788390334.672452:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.672462:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390334.672530:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958912:0@lo:501: 00000100:00100000:2.0:1788390334.675159:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.675219:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711540 going to sleep for 11 seconds 00000004:00080000:2.0:1788390334.683230:0:8792:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788390334.683294:0:8792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 155240971571ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788390334.683302:0:8792:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788390334.683386:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097958912 00000100:00100000:2.0:1788390334.683398:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097958912 00000100:00100000:2.0:1788390334.683447:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788390334.683458:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097958912:12345-0@lo:501: 00000100:00100000:2.0:1788390334.683584:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097958912:12345-0@lo:501: Request processed in 128us (8429us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390334.683592:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788390334.683649:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097958912:0@lo:501: 10000000:01000000:2.0:1788390334.683692:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788390334.683703:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390334.683713:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788390334.692550:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788390334.692681:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000004:00080000:3.0:1788390334.692754:0:8794:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788390334.692789:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb218000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8794:1875263097959168:0@lo:7: 00000100:00100000:2.0:1788390334.692925:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8787:x1875263097957376:12345-0@lo:700: Request processed in 76080us (79412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.692939:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390334.692972:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390334.692983:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097959040:0@lo:13: 00000100:00100000:2.0:1788390334.693013:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788390334.693504:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:0.0:1788390334.693630:0:8787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16d880 x1875263097957376/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390334.693645:0:8787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8787:1875263097957376:0@lo:700: 00000100:00100000:3.0:1788390334.693961:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097959040 00000100:00100000:3.0:1788390334.693968:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097959040 00000100:00100000:3.0:1788390334.694032:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390334.694042:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097959040:12345-0@lo:13: 00002000:00000024:3.0:1788390334.694082:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788390334.694132:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097959040:12345-0@lo:13: Request processed in 92us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.694139:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390334.694166:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.694186:0:8794:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1abe40 going to sleep for 11 seconds 00000100:00080000:0.0:1788390334.694650:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788390334.694732:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb21a680 x1875263097959040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.694749:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097959040:0@lo:13: 00000100:00100000:2.0:1788390334.697722:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097959168 00000100:00100000:2.0:1788390334.697735:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097959168 00000100:00100000:2.0:1788390334.697796:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390334.697806:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8794:x1875263097959168:12345-0@lo:7: 00002000:00080000:2.0:1788390334.717233:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788390334.717247:0:8407:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788390334.717348:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8794:x1875263097959168:12345-0@lo:7: Request processed in 19538us (23176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.717359:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788390334.718802:0:8794:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb218000 x1875263097959168/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.718820:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb218000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8794:1875263097959168:0@lo:7: 00000004:00080000:2.0:1788390334.718835:0:8794:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788390334.718879:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8794:1875263097959296:0@lo:5: 00000100:00100000:2.0:1788390334.718946:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.718984:0:8794:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef45480 going to sleep for 11 seconds 00000100:00100000:3.0:1788390334.719178:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097959296 00000100:00100000:3.0:1788390334.719185:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097959296 00000100:00100000:3.0:1788390334.719241:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390334.719250:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8794:x1875263097959296:12345-0@lo:5: 00002000:00080000:3.0:1788390334.719288:0:8409:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788390334.719293:0:8409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788390334.719661:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8794:x1875263097959296:12345-0@lo:5: Request processed in 412us (715us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788390334.719668:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788390334.722225:0:8794:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb151500 x1875263097959296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.722244:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8794:1875263097959296:0@lo:5: 00000004:00080000:2.0:1788390334.722259:0:8794:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788390334.722296:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8794:1875263097959424:0@lo:700: 00000100:00100000:2.0:1788390334.722364:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.722390:0:8794:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef45480 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.722412:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097959424 00000100:00100000:2.0:1788390334.722417:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097959424 00000100:00100000:2.0:1788390334.722458:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390334.722466:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8794:x1875263097959424:12345-0@lo:700: 00000001:00080000:3.0:1788390334.735756:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1788390334.735892:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8794:x1875263097959424:12345-0@lo:700: Request processed in 13421us (13522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.735904:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788390334.735954:0:8794:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb151880 x1875263097959424/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.735973:0:8794:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788390334.735992:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8794:1875263097959424:0@lo:700: 00000004:02000040:2.0:1788390334.737994:0:8794:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788390334.744826:0:8794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8794:1875263097959552:0@lo:5: 00000100:00100000:2.0:1788390334.744899:0:8794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.744941:0:8794:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef45480 going to sleep for 11 seconds 00000100:00100000:2.0:1788390334.744960:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097959552 00000100:00100000:2.0:1788390334.744967:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097959552 00000100:00100000:2.0:1788390334.745017:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390334.745025:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8794:x1875263097959552:12345-0@lo:5: 00000004:00080000:0.0:1788390334.746663:0:8787:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788390334.746691:0:8787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8787:1875263097959808:0@lo:7: 00000100:00100000:0.0:1788390334.746746:0:8787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.746781:0:8787:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390334.746794:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390334.746806:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097959680:0@lo:13: 00000100:00100000:0.0:1788390334.746833:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390334.746865:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788390334.746872:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788390334.750157:0:8409:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788390334.750173:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097959808 00000100:00100000:3.0:1788390334.750183:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097959808 00000100:00100000:3.0:1788390334.750235:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097959680 00000100:00100000:3.0:1788390334.750239:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097959680 00000100:00100000:3.0:1788390334.750268:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390334.750278:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875263097959680:12345-0@lo:13: 00002000:00000024:3.0:1788390334.750306:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788390334.750428:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875263097959680:12345-0@lo:13: Request processed in 150us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.750436:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788390334.750590:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16d880 x1875263097959680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390334.750610:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097959680:0@lo:13: 00002000:00080000:2.0:1788390334.755291:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788390334.755311:0:8407:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1788390334.759746:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8794:x1875263097959552:12345-0@lo:5: Request processed in 14713us (14837us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788390334.759761:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788390334.759819:0:8794:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb151880 x1875263097959552/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.759840:0:8794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8794:1875263097959552:0@lo:5: 00000004:00080000:2.0:1788390334.759859:0:8794:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:2.0:1788390334.759896:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390334.759910:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8787:x1875263097959808:12345-0@lo:7: 00002000:00080000:2.0:1788390334.766178:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788390334.766189:0:8407:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788390334.766708:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8787:x1875263097959808:12345-0@lo:7: Request processed in 6798us (19957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390334.766728:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788390334.769206:0:8787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16ea00 x1875263097959808/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.769236:0:8787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8787:1875263097959808:0@lo:7: 00000004:00080000:2.0:1788390334.769251:0:8787:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788390334.769295:0:8787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb152680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8787:1875263097959936:0@lo:5: 00000100:00100000:2.0:1788390334.769375:0:8787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.769539:0:8787:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390334.770604:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097959936 00000100:00100000:3.0:1788390334.770613:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097959936 00000100:00100000:3.0:1788390334.770770:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390334.770780:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8787:x1875263097959936:12345-0@lo:5: 00002000:00080000:3.0:1788390334.770810:0:8409:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788390334.770867:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8787:x1875263097959936:12345-0@lo:5: Request processed in 88us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390334.770876:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788390334.770896:0:8787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb152680 x1875263097959936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.770910:0:8787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb152680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8787:1875263097959936:0@lo:5: 00000004:00080000:2.0:1788390334.770921:0:8787:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788390334.770951:0:8787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb152680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8787:1875263097960064:0@lo:5: 00000100:00100000:2.0:1788390334.770980:0:8787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390334.770998:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097960064 00000100:00100000:2.0:1788390334.770998:0:8787:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390334.771004:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097960064 00000100:00100000:3.0:1788390334.771034:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390334.771043:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8787:x1875263097960064:12345-0@lo:5: 00002000:00080000:3.0:1788390334.771081:0:8407:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788390334.772483:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8787:x1875263097960064:12345-0@lo:5: Request processed in 1438us (1500us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788390334.772492:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788390334.772680:0:8787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb152680 x1875263097960064/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390334.772695:0:8787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb152680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8787:1875263097960064:0@lo:5: 00000004:00080000:2.0:1788390334.772708:0:8787:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788390334.772746:0:8787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8787:1875263097960192:0@lo:900: 00000100:00100000:2.0:1788390334.772789:0:8787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390334.772815:0:8787:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017000 going to sleep for 11 seconds 00000100:00100000:0.0:1788390334.775110:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097960192 00000100:00100000:0.0:1788390334.775124:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097960192 00000100:00100000:0.0:1788390334.775175:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390334.775184:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8787:x1875263097960192:12345-0@lo:900: 00000100:00100000:0.0:1788390334.775294:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8787:x1875263097960192:12345-0@lo:900: Request processed in 111us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390334.775302:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788390334.776772:0:8787:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb153b80 x1875263097960192/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788390350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390334.776789:0:8787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8787:1875263097960192:0@lo:900: 00000100:00100000:3.0:1788390335.058564:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390335.058590:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097960320:0@lo:41: 00000100:00100000:3.0:1788390335.058665:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390335.058724:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097960320 00000100:00100000:3.0:1788390335.058731:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097960320 00000100:00100000:3.0:1788390335.058771:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390335.058780:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097960320:12345-0@lo:41: 00000004:00000024:3.0:1788390335.058808:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788390335.058849:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097960320:12345-0@lo:41: Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390335.058855:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390335.058895:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097960320:0@lo:41: 00000020:00000004:0.0:1788390335.345290:0:8835:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390335.345578:0:8835:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788390335.636997:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788390336.343876:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1788390336.343896:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788390336.657486:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390337.681427:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390338.129756:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097960448:0@lo:41: 00000100:00100000:1.0:1788390338.129951:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390338.130450:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097960448 00000100:00100000:0.0:1788390338.130458:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097960448 00000100:00100000:3.0:1788390338.130813:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788390338.130829:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097960448:12345-0@lo:41: 00000004:00000024:3.0:1788390338.130862:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788390338.130931:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097960448:12345-0@lo:41: Request processed in 107us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390338.130939:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788390338.130963:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097960448:0@lo:41: 00000020:00000004:2.0:1788390338.348489:0:8936:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390338.348801:0:8936:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788390338.707058:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788390339.205896:0:8984:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390339.205908:0:8984:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1788390339.666752:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097960832:0@lo:400: 00000100:00100000:2.0:1788390339.666829:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097960576:0@lo:400: 00000100:00100000:1.0:1788390339.666841:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390339.666909:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097960960:0@lo:400: 00000100:00100000:0.0:1788390339.666986:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097960832 00000100:00100000:0.0:1788390339.666994:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097960832 00000100:00100000:0.0:1788390339.667078:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390339.667088:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097960832:12345-0@lo:400: 00000100:00100000:2.0:1788390339.674534:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390339.674580:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390339.674640:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097961472:0@lo:400: 00000100:00100000:3.0:1788390339.674681:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390339.674731:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263097960704:0@lo:400: 00000100:00100000:3.0:1788390339.674754:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390339.674772:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263097961216:0@lo:400: 00000100:00100000:3.0:1788390339.674813:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390339.674844:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097960960 00000100:00100000:3.0:1788390339.674852:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097960960 00000100:00100000:1.0:1788390339.674970:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263097961344:0@lo:400: 00000100:00100000:1.0:1788390339.674999:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390339.675064:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097960704 00000100:00100000:1.0:1788390339.675068:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097960704 00000100:00100000:1.0:1788390339.675096:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097961216 00000100:00100000:1.0:1788390339.675099:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097961216 00000100:00100000:3.0:1788390339.675171:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097961344 00000100:00100000:3.0:1788390339.675175:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097961344 00000100:00100000:3.0:1788390339.675201:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390339.675235:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788390339.675242:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788390339.675258:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097961472 00000100:00100000:1.0:1788390339.675261:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097961472 00000100:00100000:1.0:1788390339.675288:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390339.675295:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097961472:12345-0@lo:400: 00000100:00100000:1.0:1788390339.675374:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097961472:12345-0@lo:400: Request processed in 79us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390339.675382:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788390339.675412:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390339.675416:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390339.679064:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097960832:12345-0@lo:400: Request processed in 11955us (12200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390339.679079:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390339.679162:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097960832:0@lo:400: 00000100:00100000:0.0:1788390339.679295:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788390339.679308:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390339.679493:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097961088:0@lo:400: 00000100:00100000:2.0:1788390339.679533:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390339.679554:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097961600:0@lo:400: 00000100:00100000:2.0:1788390339.679577:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390339.679618:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097960576 00000100:00100000:2.0:1788390339.679625:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097960576 00000100:00100000:2.0:1788390339.679661:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788390339.679669:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3623:x1875263097960576:12345-0@lo:400: 00000100:00100000:2.0:1788390339.679717:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3623:x1875263097960576:12345-0@lo:400: Request processed in 48us (5194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390339.679723:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788390339.679750:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097961600 00000100:00100000:2.0:1788390339.679754:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097961600 00000100:00100000:2.0:1788390339.679782:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390339.679789:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097961600:12345-0@lo:400: 00000100:00100000:2.0:1788390339.679820:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097961600:12345-0@lo:400: Request processed in 33us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390339.679826:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390339.679841:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097961088 00000100:00100000:2.0:1788390339.679845:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097961088 00000100:00100000:2.0:1788390339.679866:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788390339.679885:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097961088:12345-0@lo:400: 00000100:00100000:2.0:1788390339.679916:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097961088:12345-0@lo:400: Request processed in 32us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390339.679922:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788390339.679954:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097960576:0@lo:400: 00000100:00100000:2.0:1788390339.679963:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097961088:0@lo:400: 00010000:00080000:2.0:1788390339.679974:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984f85ae0a80 x1875263097961600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390339.679982:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788390339.679992:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097961600:0@lo:400: 00000100:00100000:3.0:1788390339.680045:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263097960704:12345-0@lo:400: 00000100:00100000:3.0:1788390339.680100:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263097960704:12345-0@lo:400: Request processed in 4891us (5344us total) trans 0 rc 0/0 00010000:00080000:2.0:1788390339.680224:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984f85ae1180 x1875263097960704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390339.680235:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263097960704:0@lo:400: 00000100:00100000:3.0:1788390339.682585:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390339.682628:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788390339.682644:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390339.682659:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263097961344:12345-0@lo:400: 00000100:00100000:3.0:1788390339.682756:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263097961344:12345-0@lo:400: Request processed in 103us (7755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390339.682762:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390339.682773:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788390339.682778:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390339.682785:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263097961216:12345-0@lo:400: 00010000:00080000:2.0:1788390339.682800:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984f85ae1880 x1875263097961344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390339.682814:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263097961344:0@lo:400: 00000100:00100000:3.0:1788390339.682818:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263097961216:12345-0@lo:400: Request processed in 35us (8005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390339.682823:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788390339.682848:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984f85ae2d80 x1875263097961216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390339.682857:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263097961216:0@lo:400: 00000100:00080000:1.0:1788390339.683796:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390339.683802:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788390339.683862:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984f85ae3100 x1875263097961472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390339.683945:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788390339.683961:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097961472:0@lo:400: 00000100:00100000:0.0:1788390339.686123:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097960960:12345-0@lo:400: 00000100:00100000:0.0:1788390339.686227:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097960960:12345-0@lo:400: Request processed in 6910us (11645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390339.686236:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788390339.686812:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984f85ae2300 x1875263097960960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390339.686828:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097960960:0@lo:400: 00010000:00010000:2.0:1788390339.729461:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390340.179196:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097961728:0@lo:13: 00000100:00100000:3.0:1788390340.179312:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390340.179474:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390340.179482:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097961984:0@lo:13: 00000100:00100000:1.0:1788390340.179502:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097961856:0@lo:41: 00000100:00100000:3.0:1788390340.179507:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390340.179558:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097961728 00000100:00100000:3.0:1788390340.179566:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097961728 00000100:00100000:1.0:1788390340.179602:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390340.179603:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097961984 00000100:00100000:3.0:1788390340.179606:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097961984 00000100:00100000:3.0:1788390340.179621:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390340.179630:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097961728:12345-0@lo:13: 00000100:00100000:1.0:1788390340.179634:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097961856 00000100:00100000:1.0:1788390340.179637:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097961856 00002000:00000024:3.0:1788390340.179661:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390340.179663:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788390340.179669:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097961856:12345-0@lo:41: 00000004:00000024:1.0:1788390340.179691:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788390340.179699:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097961728:12345-0@lo:13: Request processed in 69us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390340.179705:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390340.179720:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097961856:12345-0@lo:41: Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390340.179721:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390340.179726:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390340.179727:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097961984:12345-0@lo:13: 00002000:00000024:3.0:1788390340.179735:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390340.179907:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097961856:0@lo:41: 00000100:00100000:3.0:1788390340.179930:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097961984:12345-0@lo:13: Request processed in 34us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390340.179937:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788390340.179983:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb21b480 x1875263097961984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390340.179996:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097961984:0@lo:13: 00010000:00080000:3.0:1788390340.180029:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb28f100 x1875263097961728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390340.180049:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097961728:0@lo:13: 00010000:00010000:0.0:1788390340.754495:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390341.777584:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390342.802355:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390343.249681:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390343.249705:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097962112:0@lo:41: 00000100:00100000:2.0:1788390343.249823:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390343.250095:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097962112 00000100:00100000:0.0:1788390343.250104:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097962112 00000100:00100000:0.0:1788390343.250180:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788390343.250191:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097962112:12345-0@lo:41: 00000004:00000024:0.0:1788390343.250231:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788390343.250289:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097962112:12345-0@lo:41: Request processed in 99us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390343.250296:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390343.250641:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097962112:0@lo:41: 00010000:00010000:2.0:1788390343.826499:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390344.787617:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097962496:0@lo:400: 00000100:00100000:0.0:1788390344.787681:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390344.787725:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263097963008:0@lo:400: 00000100:00100000:0.0:1788390344.787748:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390344.787777:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788390344.787783:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097962624:0@lo:400: 00000100:00100000:0.0:1788390344.787806:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390344.787824:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097963136:0@lo:400: 00000100:00100000:0.0:1788390344.787847:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390344.787881:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097962496 00000100:00100000:0.0:1788390344.787888:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097962496 00000100:00100000:0.0:1788390344.787931:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788390344.787941:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097962496:12345-0@lo:400: 00000100:00100000:2.0:1788390344.788129:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097962368:0@lo:400: 00000100:00100000:2.0:1788390344.788161:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390344.788181:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263097962880:0@lo:400: 00000100:00100000:2.0:1788390344.788202:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390344.788219:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788390344.788225:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097962240:0@lo:400: 00000100:00100000:2.0:1788390344.788253:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390344.788274:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097962752:0@lo:400: 00000100:00100000:2.0:1788390344.788296:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390344.788312:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097963264:0@lo:400: 00000100:00100000:3.0:1788390344.788509:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097963008 00000100:00100000:3.0:1788390344.788514:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097963008 00000100:00100000:3.0:1788390344.788559:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097962624 00000100:00100000:3.0:1788390344.788563:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097962624 00000100:00100000:3.0:1788390344.788572:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097962368 00000100:00100000:3.0:1788390344.788575:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097962368 00000100:00100000:3.0:1788390344.788585:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097962880 00000100:00100000:3.0:1788390344.788587:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097962880 00000100:00100000:3.0:1788390344.788603:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390344.788610:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263097963008:12345-0@lo:400: 00000100:00100000:3.0:1788390344.788654:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263097963008:12345-0@lo:400: Request processed in 44us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390344.788660:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390344.788676:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788390344.788682:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097962624:12345-0@lo:400: 00000100:00100000:3.0:1788390344.788708:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097962624:12345-0@lo:400: Request processed in 27us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390344.788714:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788390344.788725:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390344.788731:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097962368:12345-0@lo:400: 00000100:00100000:3.0:1788390344.788757:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097962368:12345-0@lo:400: Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390344.788762:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390344.788773:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788390344.788778:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263097962880:12345-0@lo:400: 00000100:00100000:3.0:1788390344.788803:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263097962880:12345-0@lo:400: Request processed in 25us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390344.788809:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788390344.788824:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390344.788828:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788390344.788861:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16ea00 x1875263097962624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390344.788876:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097962624:0@lo:400: 00010000:00080000:3.0:1788390344.788887:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16d500 x1875263097963008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390344.788895:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263097963008:0@lo:400: 00000100:00100000:1.0:1788390344.789280:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097963136 00000100:00100000:1.0:1788390344.789291:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097963136 00000100:00100000:1.0:1788390344.789349:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390344.789357:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097963136:12345-0@lo:400: 00000100:00100000:2.0:1788390344.789481:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788390344.789553:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788390344.796130:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16df80 x1875263097962368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390344.796148:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097962368:0@lo:400: 00010000:00080000:2.0:1788390344.796161:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16ca80 x1875263097962880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390344.796169:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263097962880:0@lo:400: 00000100:00100000:2.0:1788390344.796221:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097962240 00000100:00100000:2.0:1788390344.796226:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097962240 00000100:00100000:2.0:1788390344.796281:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788390344.796291:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3625:x1875263097962240:12345-0@lo:400: 00000100:00100000:2.0:1788390344.796377:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3625:x1875263097962240:12345-0@lo:400: Request processed in 87us (8122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390344.796408:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788390344.796445:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097963264 00000100:00100000:2.0:1788390344.796450:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097963264 00000100:00100000:2.0:1788390344.796494:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390344.796501:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097963264:12345-0@lo:400: 00000100:00100000:2.0:1788390344.796536:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097963264:12345-0@lo:400: Request processed in 36us (8150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390344.796542:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390344.796573:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097962240:0@lo:400: 00010000:00080000:2.0:1788390344.796584:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984f85ae2300 x1875263097963264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390344.796594:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097963264:0@lo:400: 00000100:00080000:3.0:1788390344.796738:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390344.798418:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097962752 00000100:00100000:2.0:1788390344.798429:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097962752 00000100:00100000:2.0:1788390344.798466:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788390344.798475:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097962752:12345-0@lo:400: 00000100:00100000:2.0:1788390344.798546:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097962752:12345-0@lo:400: Request processed in 71us (10248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390344.798552:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788390344.798637:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097962752:0@lo:400: 00000100:00100000:1.0:1788390344.799094:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097963136:12345-0@lo:400: Request processed in 9737us (11244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390344.799103:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788390344.799493:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb16e300 x1875263097963136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390344.799505:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097963136:0@lo:400: 00000100:00100000:0.0:1788390344.799853:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097962496:12345-0@lo:400: Request processed in 11911us (12169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390344.799862:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390344.800071:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097962496:0@lo:400: 00010000:00010000:3.0:1788390344.851101:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390345.297924:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097963392:0@lo:41: 00000100:00100000:0.0:1788390345.298032:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390345.298382:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097963392 00000100:00100000:2.0:1788390345.298390:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097963392 00000100:00100000:2.0:1788390345.298442:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390345.298453:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097963392:12345-0@lo:41: 00000004:00000024:2.0:1788390345.298709:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788390345.298765:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097963392:12345-0@lo:41: Request processed in 314us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390345.298772:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390345.298821:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097963392:0@lo:41: 00000100:00100000:2.0:1788390345.309590:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097963520:0@lo:13: 00000100:00100000:2.0:1788390345.309656:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390345.309711:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390345.309717:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097963648:0@lo:13: 00000100:00100000:2.0:1788390345.309736:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390345.309805:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097963520 00000100:00100000:3.0:1788390345.309813:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097963520 00000100:00100000:0.0:1788390345.309833:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097963648 00000100:00100000:0.0:1788390345.309840:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097963648 00000100:00100000:3.0:1788390345.309858:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390345.309870:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097963520:12345-0@lo:13: 00002000:00000024:3.0:1788390345.309900:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390345.309953:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097963520:12345-0@lo:13: Request processed in 86us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390345.309961:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390345.309988:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390345.310004:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097963648:12345-0@lo:13: 00002000:00000024:3.0:1788390345.310016:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390345.310040:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097963648:12345-0@lo:13: Request processed in 46us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390345.310046:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788390345.310167:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb28fb80 x1875263097963648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390345.310186:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097963648:0@lo:13: 00010000:00080000:2.0:1788390345.310197:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb21b480 x1875263097963520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390345.310208:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097963520:0@lo:13: 00010000:00010000:0.0:1788390345.873566:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788390346.415623:0:9483:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788390346.415628:0:9483:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788390346.415630:0:9483:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788390346.415758:0:9483:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984fc18b3800 00000020:01000004:2.0:1788390346.415774:0:9483:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788390346.415788:0:9483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788390346.415809:0:9483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff984fbac0b370) 00000020:00000080:2.0:1788390346.415829:0:9483:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788390346.457005:0:9483:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788390346.457089:0:9483:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788390346.493637:0:9483:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788390346.493887:0:9483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788390346.493905:0:9483:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788390346.493919:0:9483:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe156d0713be9744e 00000020:01000004:3.0:1788390346.493928:0:9483:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788390346.493951:0:9483:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788390346.493964:0:9483:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788390346.493974:0:9483:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788390346.494012:0:9483:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788390346.494018:0:9483:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788390346.522668:0:9483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788390346.522709:0:9483:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.111@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788390346.522714:0:9483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788390346.522716:0:9483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788390346.522717:0:9483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390346.522718:0:9483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390346.522720:0:9483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390346.522721:0:9483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390346.522722:0:9483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390346.522724:0:9483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390346.522726:0:9483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390346.522727:0:9483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390346.522729:0:9483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390346.522732:0:9483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788390346.522735:0:9483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788390346.522736:0:9483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788390346.522737:0:9483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390346.522738:0:9483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390346.522739:0:9483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390346.522741:0:9483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390346.522742:0:9483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390346.522743:0:9483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390346.522743:0:9483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390346.522745:0:9483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390346.522745:0:9483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390346.522772:0:9483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788390346.522789:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097963776:0@lo:253: 00000100:00100000:2.0:1788390346.522861:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.522916:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a37f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.526110:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097963776 00000100:00100000:0.0:1788390346.526141:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097963776 00000100:00100000:0.0:1788390346.526242:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788390346.526254:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:9483:x1875263097963776:12345-0@lo:253: 20000000:01000000:0.0:1788390346.526306:0:6484:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788390346.526311:0:6484:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788390346.526316:0:6484:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788390346.526340:0:6484:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788390346.526641:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390346.526779:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788390346.526795:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788390346.526810:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788390346.526816:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788390346.526826:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788390346.526840:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788390346.526926:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788390346.526942:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.111@tcp 20000000:01000000:0.0:1788390346.526945:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:0.0:1788390346.526973:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788390346.526981:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788390346.526996:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788390346.527002:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:0.0:1788390346.527015:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788390346.527022:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788390346.527037:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788390346.527054:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788390346.527123:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788390346.527134:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.111@tcp 20000000:01000000:0.0:1788390346.527136:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:0.0:1788390346.527150:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788390346.527156:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788390346.527169:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788390346.527183:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:0.0:1788390346.527200:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788390346.527206:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788390346.527219:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788390346.527236:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788390346.527637:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788390346.527649:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.111@tcp 20000000:01000000:0.0:1788390346.527651:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.111@tcp (null) (null) (null) 00000040:00080000:0.0:1788390346.527667:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788390346.527673:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788390346.527687:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788390346.527693:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.111@tcp (null) (null) 00000040:00080000:0.0:1788390346.527705:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788390346.527711:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788390346.527724:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788390346.527742:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788390346.527753:0:6484:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788390346.527756:0:6484:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788390346.527759:0:6484:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788390346.527802:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788390346.527805:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788390346.529384:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788390346.534002:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788390346.534041:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788390346.534058:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788390346.534069:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788390346.534071:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788390346.535742:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788390346.535780:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788390346.535801:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788390346.535970:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788390346.536003:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788390346.536018:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1788390346.536029:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788390346.536033:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788390346.536594:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788390346.536624:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788390346.536635:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788390346.536752:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788390346.536774:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788390346.536791:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788390346.536800:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788390346.536802:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788390346.539278:0:9492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788390346.539390:0:9492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788390346.539413:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788390346.539598:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788390346.539620:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788390346.539635:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788390346.539648:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788390346.539651:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788390346.542279:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788390346.543106:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788390346.543135:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788390346.552651:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788390346.552692:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788390346.552709:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:2.0:1788390346.552729:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788390346.552752:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552771:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97344 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552780:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9736e expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552786:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be973ad expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552793:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be973c9 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552799:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be973f3 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552805:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9740f expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552827:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97439 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552834:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552875:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97439 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.552890:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97439 expref: 21 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.552905:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097963904:0@lo:104: 00000100:00100000:2.0:1788390346.552978:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390346.553105:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9740f expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.553113:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9740f expref: 21 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.553122:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964032:0@lo:104: 00000100:00100000:2.0:1788390346.553143:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390346.553654:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be973f3 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.553665:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be973f3 expref: 21 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.553674:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964160:0@lo:104: 00000100:00100000:2.0:1788390346.553704:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.553758:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097963904 00000100:00100000:1.0:1788390346.553767:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097963904 00000100:00100000:1.0:1788390346.553808:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097964032 00000100:00100000:1.0:1788390346.553811:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097964032 00000100:00100000:1.0:1788390346.553826:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390346.553835:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6484:x1875263097963904:12345-0@lo:104: 00010000:00010000:1.0:1788390346.553880:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.553941:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390346.553948:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6484:x1875263097963904:12345-0@lo:104: Request processed in 114us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.553965:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390346.553988:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390346.553996:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6484:x1875263097964032:12345-0@lo:104: 00010000:00010000:1.0:1788390346.554005:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554042:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788390346.554048:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6484:x1875263097964032:12345-0@lo:104: Request processed in 54us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.554063:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788390346.554110:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390346.554116:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554124:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735600 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390346.554129:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554138:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390346.554147:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390346.554152:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390346.554184:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554189:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390346.554209:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554216:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be97439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97440 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554235:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390346.554238:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554253:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734a00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390346.554256:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554261:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390346.554267:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390346.554272:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390346.554285:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554291:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390346.554296:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554301:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf734a00/0xe156d0713be9740f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97416 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554312:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390346.554313:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390346.554315:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390346.554360:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097964288:0@lo:103: 00000100:00100000:1.0:1788390346.554390:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.554416:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390346.554421:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097964416:0@lo:103: 00000100:00100000:1.0:1788390346.554451:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.554481:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097964288 00000100:00100000:1.0:1788390346.554485:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097964288 00010000:00010000:1.0:1788390346.554502:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97439 expref: 22 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390346.554519:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097964416 00000100:00100000:1.0:1788390346.554521:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097964416 00010000:00010000:1.0:1788390346.554529:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9740f expref: 23 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390346.554540:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390346.554544:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3624:x1875263097964288:12345-0@lo:103: 00010000:00010000:1.0:1788390346.554553:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390346.554558:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97439 expref: 23 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554568:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97439 expref: 23 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554582:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390346.554605:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3624:x1875263097964288:12345-0@lo:103: Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.554611:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390346.554622:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390346.554627:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:3624:x1875263097964416:12345-0@lo:103: 00010000:00010000:1.0:1788390346.554634:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390346.554637:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9740f expref: 22 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554655:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9740f expref: 22 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.554664:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390346.554680:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:3624:x1875263097964416:12345-0@lo:103: Request processed in 53us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.554686:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390346.554718:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097964416:0@lo:103: 00000100:00100000:1.0:1788390346.554725:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097964288:0@lo:103: 00010000:00010000:3.0:1788390346.554844:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390346.554925:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be973c9 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.554935:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be973c9 expref: 21 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.554944:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964544:0@lo:104: 00000100:00100000:2.0:1788390346.554990:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390346.555014:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be973ad expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.555022:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be973ad expref: 21 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.555030:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964672:0@lo:104: 00000100:00100000:2.0:1788390346.555047:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390346.555060:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9736e expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.555067:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9736e expref: 21 pid: 6484 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.555075:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964800:0@lo:104: 00000100:00100000:2.0:1788390346.555105:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390346.555123:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97344 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.555130:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97344 expref: 21 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.555149:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964928:0@lo:104: 00000100:00100000:2.0:1788390346.555169:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a37b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788390346.555182:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20ce400/0xe156d0713be97440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97439 expref: 21 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.555192:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097963904:0@lo:104: 00010000:00010000:2.0:1788390346.555199:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf734c00/0xe156d0713be97416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9740f expref: 20 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.555207:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964032:0@lo:104: 00000100:00100000:0.0:1788390346.555260:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097964160 00000100:00100000:0.0:1788390346.555265:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097964160 00000100:00100000:0.0:1788390346.555293:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788390346.555338:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.555353:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097964544 00000100:00100000:0.0:1788390346.555356:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097964544 00000100:00100000:0.0:1788390346.555368:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097964672 00000100:00100000:0.0:1788390346.555370:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097964672 00000100:00100000:0.0:1788390346.555376:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097964800 00000100:00100000:0.0:1788390346.555378:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097964800 00000100:00100000:0.0:1788390346.555385:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097964928 00000100:00100000:0.0:1788390346.555387:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097964928 00000100:00100000:0.0:1788390346.555396:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390346.555402:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+7:6484:x1875263097964160:12345-0@lo:104: 00010000:00010000:0.0:1788390346.555410:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555449:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390346.555454:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+7:6484:x1875263097964160:12345-0@lo:104: Request processed in 53us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.555460:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390346.555477:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788390346.555483:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+6:6484:x1875263097964544:12345-0@lo:104: 00010000:00010000:0.0:1788390346.555490:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555520:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788390346.555525:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+6:6484:x1875263097964544:12345-0@lo:104: Request processed in 43us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.555531:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788390346.555542:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788390346.555547:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+5:6484:x1875263097964672:12345-0@lo:104: 00010000:00010000:0.0:1788390346.555554:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555582:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788390346.555587:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+5:6484:x1875263097964672:12345-0@lo:104: Request processed in 40us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.555593:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788390346.555605:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788390346.555611:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e866ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6484:x1875263097964800:12345-0@lo:104: 00010000:00010000:0.0:1788390346.555618:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555641:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788390346.555646:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e866ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6484:x1875263097964800:12345-0@lo:104: Request processed in 36us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.555651:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788390346.555675:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788390346.555680:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6484:x1875263097964928:12345-0@lo:104: 00010000:00010000:0.0:1788390346.555686:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555704:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788390346.555708:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6484:x1875263097964928:12345-0@lo:104: Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.555714:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788390346.555725:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788390346.555729:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555736:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80031c00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390346.555744:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555753:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390346.555760:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390346.555766:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390346.555783:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555789:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390346.555801:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555808:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be973f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555817:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788390346.555820:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555826:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cf600 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390346.555828:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555835:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390346.555849:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390346.555854:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390346.555864:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555869:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390346.555873:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555880:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20cf600/0xe156d0713be973c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555888:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788390346.555891:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555896:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80030400 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390346.555899:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555906:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390346.555911:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390346.555916:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390346.555928:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555933:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390346.555940:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555946:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be973ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973b4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555967:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390346.555971:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555976:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390346.555979:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.555985:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390346.555991:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390346.555996:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390346.556006:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.556012:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390346.556016:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.556030:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be9736e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97375 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.556038:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390346.556041:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.556046:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390346.556049:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.556055:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390346.556061:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390346.556066:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390346.556074:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.556079:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390346.556082:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.556087:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf735000/0xe156d0713be97344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9734b expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.556098:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390346.556104:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390346.556106:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390346.556118:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097965056:0@lo:103: 00000100:00100000:0.0:1788390346.556144:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.556166:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097965568:0@lo:103: 00000100:00100000:0.0:1788390346.556187:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.556203:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390346.556209:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097965184:0@lo:103: 00000100:00100000:0.0:1788390346.556228:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390346.556301:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390346.556386:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964160:0@lo:104: 00000100:00100000:2.0:1788390346.556396:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964544:0@lo:104: 00000100:00100000:2.0:1788390346.556404:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964672:0@lo:104: 00000100:00100000:2.0:1788390346.556412:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964800:0@lo:104: 00000100:00100000:2.0:1788390346.556418:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6484:1875263097964928:0@lo:104: 00010000:00010000:2.0:1788390346.556443:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390346.556950:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097965056 00000100:00100000:1.0:1788390346.556968:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097965056 00010000:00010000:1.0:1788390346.556995:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be973f3 expref: 20 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390346.557015:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097965568 00000100:00100000:1.0:1788390346.557018:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097965568 00010000:00010000:1.0:1788390346.557028:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97344 expref: 21 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390346.557037:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097965184 00000100:00100000:1.0:1788390346.557040:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097965184 00010000:00010000:1.0:1788390346.557048:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be973c9 expref: 22 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390346.557060:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390346.557067:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+22:3622:x1875263097965056:12345-0@lo:103: 00010000:00010000:1.0:1788390346.557077:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390346.557082:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be973f3 expref: 22 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557100:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be973f3 expref: 22 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557112:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf735a00/0xe156d0713be973fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be973f3 expref: 22 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557123:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390346.557167:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3622:x1875263097965056:12345-0@lo:103: Request processed in 100us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.557173:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390346.557190:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390346.557196:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+20:3622:x1875263097965568:12345-0@lo:103: 00010000:00010000:1.0:1788390346.557203:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390346.557208:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97344 expref: 20 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557216:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97344 expref: 20 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557225:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cee00/0xe156d0713be9734b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97344 expref: 20 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557233:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390346.557256:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3622:x1875263097965568:12345-0@lo:103: Request processed in 61us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.557262:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390346.557301:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390346.557307:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:3622:x1875263097965184:12345-0@lo:103: 00010000:00010000:1.0:1788390346.557437:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390346.557443:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be973c9 expref: 18 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557453:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be973c9 expref: 18 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557463:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cfa00/0xe156d0713be973d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be973c9 expref: 18 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557471:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390346.557494:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:3622:x1875263097965184:12345-0@lo:103: Request processed in 187us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.557500:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390346.557520:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097965440:0@lo:103: 00000100:00100000:1.0:1788390346.557544:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.557575:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390346.557581:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097965312:0@lo:103: 00000100:00100000:1.0:1788390346.557600:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.557620:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097965440 00000100:00100000:1.0:1788390346.557623:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097965440 00010000:00010000:1.0:1788390346.557636:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9736e expref: 17 pid: 6484 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390346.557648:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097965312 00000100:00100000:1.0:1788390346.557650:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097965312 00010000:00010000:1.0:1788390346.557660:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be973ad expref: 18 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390346.557672:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390346.557685:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:3625:x1875263097965440:12345-0@lo:103: 00010000:00010000:1.0:1788390346.557693:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390346.557697:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9736e expref: 18 pid: 6484 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557705:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9736e expref: 18 pid: 6484 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557715:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cea00/0xe156d0713be97375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9736e expref: 18 pid: 6484 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557724:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390346.557805:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:3625:x1875263097965440:12345-0@lo:103: Request processed in 121us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.557812:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390346.557826:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390346.557833:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:3625:x1875263097965312:12345-0@lo:103: 00010000:00010000:1.0:1788390346.557840:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390346.557845:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be973ad expref: 16 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557853:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be973ad expref: 16 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557863:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cec00/0xe156d0713be973b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be973ad expref: 16 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557874:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557893:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557907:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557913:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557919:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557925:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557930:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390346.557934:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557942:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557972:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.557984:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390346.558005:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3625:x1875263097965312:12345-0@lo:103: Request processed in 174us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.558011:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788390346.558046:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.558060:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.558067:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b5400/0xe156d0713be97455 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788390346.558081:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788390346.558654:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097965184:0@lo:103: 00000100:00100000:0.0:1788390346.558664:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097965056:0@lo:103: 00000100:00100000:0.0:1788390346.558671:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097965568:0@lo:103: 00000100:00100000:3.0:1788390346.558928:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097965440:0@lo:103: 00000100:00100000:3.0:1788390346.558941:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263097965312:0@lo:103: 00000100:00100000:1.0:1788390346.560760:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+14:9483:x1875263097963776:12345-0@lo:253: Request processed in 34503us (37893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.560772:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788390346.560854:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097963776:0@lo:253: 10000000:01000000:2.0:1788390346.560869:0:9483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788390346.560873:0:9483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788390346.560875:0:9483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788390346.560876:0:9483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390346.560877:0:9483:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788390346.560878:0:9483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390346.560879:0:9483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390346.560890:0:9483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390346.560892:0:9483:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788390346.560894:0:9483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390346.560895:0:9483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788390346.560918:0:9483:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984fc18b3800 from lustre-OST0001 10000000:01000000:2.0:1788390346.560949:0:9483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788390346.560952:0:9483:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788390346.560971:0:9483:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984f88c4cd28 local copy 10000000:01000000:2.0:1788390346.560976:0:9483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788390346.561010:0:9483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.561021:0:9483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.561030:0:9483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.561048:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097965696:0@lo:101: 00000100:00100000:2.0:1788390346.561138:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.561209:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.561250:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097965696 00000100:00100000:0.0:1788390346.561257:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097965696 00000100:00100000:0.0:1788390346.561396:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788390346.561406:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+14:9483:x1875263097965696:12345-0@lo:101: 00010000:00010000:0.0:1788390346.561419:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390346.561432:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f80030400/0xe156d0713be97463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9745c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.561514:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f80030400/0xe156d0713be97463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9745c expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.561525:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f80030400/0xe156d0713be97463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9745c expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.561533:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f80030400, rc 0) 00000100:00100000:0.0:1788390346.561568:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097965696:12345-0@lo:101: Request processed in 163us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.561574:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788390346.561636:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097965696:0@lo:101: 00010000:00010000:2.0:1788390346.561647:0:9483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.561656:0:9483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.561739:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097965824:0@lo:501: 00000100:00100000:2.0:1788390346.561765:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.561873:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390346.561948:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097965824 00000100:00100000:1.0:1788390346.561953:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097965824 00000100:00100000:1.0:1788390346.561988:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788390346.561994:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097965824:12345-0@lo:501: 00000100:00100000:1.0:1788390346.562067:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097965824:12345-0@lo:501: Request processed in 72us (301us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390346.562074:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788390346.562192:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097965824:0@lo:501: 10000000:01000000:2.0:1788390346.562203:0:9483:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788390346.562219:0:9483:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788390346.562223:0:9483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.562231:0:9483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.562239:0:9483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.562262:0:9483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788390346.562281:0:9483:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984fc18b3800 10000000:01000000:2.0:1788390346.562285:0:9483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788390346.562290:0:9483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788390346.562292:0:9483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788390346.562296:0:9483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788390346.562298:0:9483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788390346.562312:0:9483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.562348:0:9483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.562356:0:9483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.562367:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097965952:0@lo:101: 00000100:00100000:2.0:1788390346.562390:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.562406:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a37b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390346.562469:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097965952 00000100:00100000:1.0:1788390346.562473:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097965952 00000100:00100000:1.0:1788390346.562489:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788390346.562495:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097965952:12345-0@lo:101: 00010000:00010000:1.0:1788390346.562501:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390346.562509:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9746a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.562522:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9746a expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.562540:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9746a expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.562547:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cf400, rc 0) 00000100:00100000:1.0:1788390346.562583:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097965952:12345-0@lo:101: Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.562589:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:1.0:1788390346.562610:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390346.562616:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.562623:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390346.562627:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.562636:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390346.562643:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390346.562649:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390346.562668:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.562675:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390346.562694:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.562711:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4a00/0xe156d0713be9745c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe156d0713be97463 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.562723:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390346.562725:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390346.562727:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390346.562739:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097966080:0@lo:103: 00000100:00100000:1.0:1788390346.562767:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.562797:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097966080 00000100:00100000:1.0:1788390346.562801:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097966080 00000100:00100000:1.0:1788390346.562830:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390346.562837:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:3623:x1875263097966080:12345-0@lo:103: 00010000:00010000:1.0:1788390346.562845:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390346.562857:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80030400/0xe156d0713be97463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be9745c expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.562867:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390346.562892:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3623:x1875263097966080:12345-0@lo:103: Request processed in 56us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.562898:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390346.562924:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097966080:0@lo:103: 00000100:00100000:2.0:1788390346.563059:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097965952:0@lo:101: 00010000:00010000:2.0:1788390346.563070:0:9483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.563078:0:9483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.563142:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966208:0@lo:501: 00000100:00100000:2.0:1788390346.563166:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.563194:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a37b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390346.563283:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097966208 00000100:00100000:1.0:1788390346.563287:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097966208 00000100:00100000:1.0:1788390346.563306:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788390346.563313:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097966208:12345-0@lo:501: 00000100:00100000:1.0:1788390346.563437:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097966208:12345-0@lo:501: Request processed in 124us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.563465:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788390346.563589:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966208:0@lo:501: 00000100:00100000:2.0:1788390346.563612:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966336:0@lo:503: 00000100:00100000:2.0:1788390346.563649:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.563673:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a37b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390346.563715:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097966336 00000100:00100000:1.0:1788390346.563719:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097966336 00000100:00100000:1.0:1788390346.563735:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788390346.563741:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097966336:12345-0@lo:503: 00000100:00100000:1.0:1788390346.563818:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097966336:12345-0@lo:503: Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.563824:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788390346.563890:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966336:0@lo:503: 00000040:00080000:2.0:1788390346.564178:0:9483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390346.564245:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966464:0@lo:502: 00000100:00100000:2.0:1788390346.564285:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.564307:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a37b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.564500:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097966464 00000100:00100000:0.0:1788390346.564507:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097966464 00000100:00100000:0.0:1788390346.564535:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788390346.564543:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097966464:12345-0@lo:502: 00000100:00100000:0.0:1788390346.564631:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097966464:12345-0@lo:502: Request processed in 89us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.564639:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788390346.564812:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966464:0@lo:502: 00000040:00080000:2.0:1788390346.565035:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788390346.565060:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788390346.565074:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788390346.565097:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788390346.565112:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788390346.565126:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788390346.565154:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966592:0@lo:502: 00000100:00100000:2.0:1788390346.565190:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.565217:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a37b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390346.565390:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097966592 00000100:00100000:1.0:1788390346.565394:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097966592 00000100:00100000:1.0:1788390346.565417:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788390346.565423:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097966592:12345-0@lo:502: 00000100:00100000:1.0:1788390346.565509:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097966592:12345-0@lo:502: Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.565516:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788390346.566093:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966592:0@lo:502: 00000040:00080000:2.0:1788390346.566142:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788390346.566151:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1788390346.566714:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788390346.566722:0:9494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788390346.566729:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390346.566732:0:9494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788390346.566737:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788390346.566765:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff984e87428000) 00000020:00000080:1.0:1788390346.566791:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788390346.566800:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788390346.566891:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fc18b3800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788390346.566901:0:9494:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788390346.566909:0:9494:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe156d0713be9747f 00010000:00010000:1.0:1788390346.572039:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1788390346.572876:0:9494:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788390346.575674:0:9494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788390346.576162:0:9494:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788390346.584043:0:9494:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788390346.584237:0:9494:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788390346.591307:0:9494:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788390346.593569:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788390346.593580:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390346.593586:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390346.593589:0:9494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788390346.593593:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390346.593598:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390346.593599:0:9494:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390346.593603:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390346.593605:0:9494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788390346.593627:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390346.593630:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390346.593632:0:9494:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788390346.593635:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788390346.593773:0:9483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788390346.593802:0:9483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788390346.593823:0:9483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.593837:0:9483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390346.593845:0:9483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fc18b3800 from 1 10000000:01000000:3.0:1788390346.593848:0:9483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390346.593886:0:9483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.593895:0:9483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.593907:0:9483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390346.593928:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966720:0@lo:101: 00000100:00100000:3.0:1788390346.594004:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390346.594046:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390346.595638:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097966720 00000100:00100000:1.0:1788390346.595654:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097966720 00000100:00100000:1.0:1788390346.595706:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788390346.595715:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+15:9483:x1875263097966720:12345-0@lo:101: 00010000:00010000:1.0:1788390346.595730:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390346.595745:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97486 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.595771:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97486 expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.595781:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97486 expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390346.595790:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cea00, rc 0) 00000100:00100000:1.0:1788390346.595842:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097966720:12345-0@lo:101: Request processed in 129us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.595849:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788390346.595951:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966720:0@lo:101: 00010000:00010000:3.0:1788390346.595978:0:9483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.595987:0:9483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390346.596078:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966848:0@lo:501: 00000100:00100000:3.0:1788390346.596112:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390346.596145:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390346.596260:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097966848 00000100:00100000:1.0:1788390346.596264:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097966848 00000100:00100000:1.0:1788390346.596294:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788390346.596300:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097966848:12345-0@lo:501: 00000100:00100000:1.0:1788390346.596406:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097966848:12345-0@lo:501: Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.596412:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788390346.596440:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966848:0@lo:501: 00000100:00100000:1.0:1788390346.596670:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966976:0@lo:503: 00000100:00100000:1.0:1788390346.596708:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.596771:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390346.600157:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097966976 00000100:00100000:3.0:1788390346.600173:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097966976 00000100:00100000:3.0:1788390346.600228:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788390346.600238:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097966976:12345-0@lo:503: 00000100:00100000:3.0:1788390346.600404:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097966976:12345-0@lo:503: Request processed in 167us (3694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390346.600412:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788390346.600562:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097966976:0@lo:503: 00000040:00080000:2.0:1788390346.600793:0:9483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390346.600866:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967104:0@lo:502: 00000100:00100000:2.0:1788390346.600910:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.600940:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390346.600988:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097967104 00000100:00100000:3.0:1788390346.600993:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097967104 00000100:00100000:3.0:1788390346.601025:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788390346.601032:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097967104:12345-0@lo:502: 00000100:00100000:3.0:1788390346.601097:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097967104:12345-0@lo:502: Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390346.601103:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788390346.601185:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967104:0@lo:502: 00000040:00080000:2.0:1788390346.601366:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788390346.601388:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788390346.601406:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967232:0@lo:502: 00000100:00100000:2.0:1788390346.601439:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.601468:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390346.601483:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097967232 00000100:00100000:2.0:1788390346.601487:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097967232 00000100:00100000:2.0:1788390346.601505:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788390346.601511:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097967232:12345-0@lo:502: 00000100:00100000:2.0:1788390346.601577:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097967232:12345-0@lo:502: Request processed in 65us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390346.601594:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788390346.601623:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967232:0@lo:502: 00000040:00080000:2.0:1788390346.601654:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788390346.601661:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788390346.603595:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390346.603608:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390346.603611:0:9498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788390346.603618:0:9498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fc18b3800 00000020:00000080:0.0:1788390346.603621:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788390346.603642:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390346.603646:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390346.603647:0:9498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788390346.603651:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788390346.603697:0:9483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788390346.603728:0:9483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390346.603743:0:9483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.603755:0:9483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390346.603797:0:9483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788390346.603800:0:9483:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984fc18b3800 10000000:01000000:0.0:1788390346.603803:0:9483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984fc18b3800 10000000:01000000:0.0:1788390346.603807:0:9483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390346.603813:0:9483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fc18b3800 from 1 10000000:01000000:0.0:1788390346.603816:0:9483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788390346.603845:0:9483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.603853:0:9483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.603865:0:9483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390346.603883:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967360:0@lo:101: 00000100:00100000:0.0:1788390346.603936:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.603978:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.604001:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097967360 00000100:00100000:0.0:1788390346.604011:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097967360 00000100:00100000:0.0:1788390346.604047:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788390346.604056:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:9483:x1875263097967360:12345-0@lo:101: 00010000:00010000:0.0:1788390346.604068:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390346.604080:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97494 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.604103:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97494 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.604114:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97494 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.604123:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f80030200, rc 0) 00000100:00100000:0.0:1788390346.604158:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097967360:12345-0@lo:101: Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.604164:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788390346.604213:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967360:0@lo:101: 00010000:00010000:0.0:1788390346.604224:0:9483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.604232:0:9483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390346.604300:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967488:0@lo:501: 00000100:00100000:0.0:1788390346.604351:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.604365:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.604379:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097967488 00000100:00100000:0.0:1788390346.604382:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097967488 00000100:00100000:0.0:1788390346.604410:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788390346.604417:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097967488:12345-0@lo:501: 00000100:00100000:0.0:1788390346.605314:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097967488:12345-0@lo:501: Request processed in 894us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.605368:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788390346.605413:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967488:0@lo:501: 00000100:00100000:0.0:1788390346.605445:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967616:0@lo:503: 00000100:00100000:0.0:1788390346.605501:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.605524:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.605537:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097967616 00000100:00100000:0.0:1788390346.605542:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097967616 00000100:00100000:0.0:1788390346.605567:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788390346.605574:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097967616:12345-0@lo:503: 00000100:00100000:0.0:1788390346.605652:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097967616:12345-0@lo:503: Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.605658:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788390346.605694:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967616:0@lo:503: 00000040:00080000:0.0:1788390346.605901:0:9483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788390346.605969:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967744:0@lo:502: 00000100:00100000:0.0:1788390346.606001:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.606015:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.606028:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097967744 00000100:00100000:0.0:1788390346.606031:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097967744 00000100:00100000:0.0:1788390346.606052:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788390346.606058:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097967744:12345-0@lo:502: 00000100:00100000:0.0:1788390346.606132:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097967744:12345-0@lo:502: Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.606145:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788390346.606184:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967744:0@lo:502: 00000040:00080000:0.0:1788390346.606394:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788390346.606417:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788390346.606430:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788390346.606443:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788390346.606456:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788390346.606480:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788390346.606494:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788390346.606506:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788390346.606519:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788390346.606531:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788390346.606543:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788390346.606556:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788390346.606569:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788390346.606585:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788390346.606599:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788390346.606611:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788390346.606623:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788390346.606636:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788390346.606650:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788390346.606663:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788390346.606677:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788390346.606701:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788390346.606733:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788390346.606747:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788390346.606757:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788390346.606768:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788390346.606778:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788390346.606789:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788390346.606800:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788390346.606825:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788390346.606838:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788390346.606850:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788390346.606862:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788390346.606874:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788390346.606887:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788390346.606898:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788390346.606911:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788390346.606935:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788390346.606949:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788390346.606977:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788390346.606991:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788390346.607004:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788390346.607018:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788390346.607031:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788390346.607043:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788390346.607055:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788390346.607081:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967872:0@lo:502: 00000100:00100000:0.0:1788390346.607129:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.607150:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.607169:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097967872 00000100:00100000:0.0:1788390346.607174:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097967872 00000100:00100000:0.0:1788390346.607204:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788390346.607212:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097967872:12345-0@lo:502: 00000100:00100000:0.0:1788390346.607291:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097967872:12345-0@lo:502: Request processed in 80us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.607297:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788390346.607364:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097967872:0@lo:502: 00000040:00080000:0.0:1788390346.607399:0:9483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788390346.607407:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788390346.609183:0:9499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788390346.609199:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff984fbac0cd28) 00000020:00000080:2.0:1788390346.609222:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788390346.609303:0:9499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fc18b3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788390346.609307:0:9499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fc18b3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788390346.609310:0:9499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fc18b3800 3 00010000:00080000:2.0:1788390346.609398:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e876bc000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.111@tcp at head 00010000:00010000:2.0:1788390346.611159:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788390346.614915:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788390346.614975:0:9499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788390346.614989:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe156d0713be974a9 00000100:00080000:2.0:1788390346.615000:0:9499:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390346.615007:0:9499:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff984e876bc000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390346.615056:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e8741bb80 x1875263097968000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788390346.615086:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788390346.615609:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263097968000:0@lo:38: 00000100:00100000:1.0:1788390346.615678:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390346.616555:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097968000 00000100:00100000:3.0:1788390346.616565:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097968000 00000100:00100000:3.0:1788390346.616606:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390346.616614:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875263097968000:12345-0@lo:38: 00010000:00080000:3.0:1788390346.616638:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1788390346.616671:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe156d0713be974b0 00000004:00100000:3.0:1788390346.616686:0:6493:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788390346.616714:0:6493:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390346.616769:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875263097968000:12345-0@lo:38: Request processed in 154us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390346.616776:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788390346.617772:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e8741bb80 x1875263097968000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390346.617786:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390346.617797:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788390346.617805:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788390346.617810:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788390346.617813:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e876bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788390346.617820:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263097968000:0@lo:38: 00000100:00100000:1.0:1788390346.618551:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263097968128:0@lo:400: 00000100:00100000:1.0:1788390346.618602:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.618627:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263097968640:0@lo:400: 00000100:00100000:1.0:1788390346.618644:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.618661:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788390346.618666:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097968256:0@lo:400: 00000100:00100000:1.0:1788390346.618686:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.618700:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263097968768:0@lo:400: 00000100:00100000:1.0:1788390346.618717:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.618736:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097968512:0@lo:400: 00000100:00100000:1.0:1788390346.618754:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.618769:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097969024:0@lo:400: 00000100:00100000:1.0:1788390346.618788:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.618813:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097968128 00000100:00100000:1.0:1788390346.618819:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097968128 00000100:00100000:1.0:1788390346.618864:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097968640 00000100:00100000:1.0:1788390346.618867:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097968640 00000100:00100000:1.0:1788390346.618888:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097968768 00000100:00100000:1.0:1788390346.618890:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097968768 00000100:00100000:1.0:1788390346.618904:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788390346.618912:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263097968128:12345-0@lo:400: 00000100:00100000:1.0:1788390346.618969:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263097968128:12345-0@lo:400: Request processed in 43us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.618976:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788390346.618995:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390346.619001:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263097968640:12345-0@lo:400: 00000100:00100000:1.0:1788390346.619028:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263097968640:12345-0@lo:400: Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.619033:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390346.619045:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390346.619050:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263097968768:12345-0@lo:400: 00000100:00100000:1.0:1788390346.619077:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263097968768:12345-0@lo:400: Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.619082:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390346.619104:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097968256 00000100:00100000:1.0:1788390346.619108:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097968256 00000100:00100000:1.0:1788390346.619130:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097968512 00000100:00100000:1.0:1788390346.619133:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097968512 00000100:00100000:1.0:1788390346.619145:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788390346.619151:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097968256:12345-0@lo:400: 00000100:00100000:1.0:1788390346.619182:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097968256:12345-0@lo:400: Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.619188:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788390346.619208:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788390346.619214:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097968512:12345-0@lo:400: 00000100:00100000:1.0:1788390346.619245:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097968512:12345-0@lo:400: Request processed in 31us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.619251:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788390346.619270:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097969024 00000100:00100000:1.0:1788390346.619273:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097969024 00000100:00100000:1.0:1788390346.619297:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390346.619303:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097969024:12345-0@lo:400: 00000100:00100000:1.0:1788390346.619360:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097969024:12345-0@lo:400: Request processed in 57us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.619366:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788390346.619385:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390346.619389:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390346.619391:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390346.619419:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097968512:0@lo:400: 00010000:00080000:1.0:1788390346.619430:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e877cb800 x1875263097969024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390346.619441:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097969024:0@lo:400: 00000100:00100000:1.0:1788390346.619546:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097968256:0@lo:400: 00010000:00080000:1.0:1788390346.619556:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e877c9c00 x1875263097968768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390346.619567:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263097968768:0@lo:400: 00010000:00080000:1.0:1788390346.619576:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e1f80 x1875263097968128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390346.619595:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263097968128:0@lo:400: 00010000:00080000:1.0:1788390346.619606:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e1c00 x1875263097968640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390346.619614:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263097968640:0@lo:400: 00000100:00100000:0.0:1788390346.619726:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097968384:0@lo:400: 00000100:00100000:0.0:1788390346.619759:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.619787:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097968896:0@lo:400: 00000100:00100000:0.0:1788390346.619807:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390346.619976:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097968896 00000100:00100000:3.0:1788390346.619981:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097968896 00000100:00100000:3.0:1788390346.620024:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390346.620031:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097968896:12345-0@lo:400: 00000100:00100000:3.0:1788390346.620066:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097968896:12345-0@lo:400: Request processed in 36us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390346.620072:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788390346.620113:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788390346.620133:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e877ca300 x1875263097968896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390346.620143:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097968896:0@lo:400: 00000100:00100000:1.0:1788390346.620193:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097968384 00000100:00100000:1.0:1788390346.620197:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097968384 00000100:00100000:1.0:1788390346.620230:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788390346.620237:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097968384:12345-0@lo:400: 00000100:00100000:1.0:1788390346.620314:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263097968384:12345-0@lo:400: Request processed in 78us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.620347:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:01000004:1.0:1788390346.620586:0:9499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788390346.620601:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff984e874299b8) 00000020:00000080:1.0:1788390346.620623:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788390346.620714:0:9499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fc18b3800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788390346.620718:0:9499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fc18b3800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788390346.620721:0:9499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fc18b3800 3 00010000:00080000:1.0:1788390346.620750:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e877d3000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.111@tcp at head 00000100:00100000:0.0:1788390346.622443:0:9501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9501:1875263097969152:0@lo:901: 00000100:00100000:0.0:1788390346.622518:0:9501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.622545:0:9501:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25900 going to sleep for 11 seconds 00000100:00100000:2.0:1788390346.622651:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097969152 00000100:00100000:2.0:1788390346.622658:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097969152 00000100:00100000:2.0:1788390346.622713:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390346.622722:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9501:x1875263097969152:12345-0@lo:901: 00000100:00100000:2.0:1788390346.622802:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9501:x1875263097969152:12345-0@lo:901: Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390346.622810:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788390346.622977:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788390346.623004:0:9501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e877ca300 x1875263097969152/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788390362 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390346.623019:0:9501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9501:1875263097969152:0@lo:901: 00010000:00080000:3.0:1788390346.624577:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fb76e2300 x1875263097968384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390346.624605:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263097968384:0@lo:400: 00010000:00010000:1.0:1788390346.624744:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788390346.624987:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788390346.625028:0:9499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788390346.625041:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe156d0713be974be 00000100:00080000:1.0:1788390346.625048:0:9499:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390346.625053:0:9499:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff984e877d3000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390346.625080:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984fbb2ab100 x1875263097969280/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390346.625119:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788390346.625369:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1875263097969280:0@lo:38: 00000100:00100000:2.0:1788390346.625423:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390346.625557:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097969280 00000100:00100000:1.0:1788390346.625564:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097969280 00000100:00100000:1.0:1788390346.625592:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390346.625599:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263097969280:12345-0@lo:38: 00010000:00080000:1.0:1788390346.625621:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:1.0:1788390346.625647:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe156d0713be974c5 00000004:00100000:1.0:1788390346.625661:0:6494:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788390346.625686:0:6494:0:(import.c:65:import_set_state_nolock()) ffff984e877d5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390346.625725:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875263097969280:12345-0@lo:38: Request processed in 125us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390346.625732:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788390346.625800:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984fbb2ab100 x1875263097969280/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390346.625809:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788390346.625815:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788390346.625820:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788390346.625824:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788390346.625826:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e877d3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788390346.625831:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1875263097969280:0@lo:38: 00000040:00080000:0.0:1788390346.625946:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788390346.626079:0:9483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788390346.626111:0:9483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788390346.626131:0:9483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390346.626143:0:9483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788390346.626192:0:9483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788390346.626194:0:9483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788390346.626195:0:9483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390346.626196:0:9483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390346.626198:0:9483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390346.626200:0:9483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390346.626201:0:9483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390346.626202:0:9483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390346.626204:0:9483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390346.626206:0:9483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390346.626207:0:9483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788390346.626210:0:9483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788390346.626213:0:9483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788390346.626219:0:9483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788390346.626220:0:9483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390346.626221:0:9483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390346.626222:0:9483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390346.626223:0:9483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390346.626224:0:9483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390346.626225:0:9483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390346.626226:0:9483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390346.626227:0:9483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390346.626228:0:9483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788390346.626243:0:9483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788390346.626253:0:9483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097969408:0@lo:253: 00000100:00100000:2.0:1788390346.626287:0:9483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390346.626305:0:9483:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.626519:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097969408 00000100:00100000:0.0:1788390346.626524:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097969408 00000100:00100000:0.0:1788390346.626564:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788390346.626572:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097969408:12345-0@lo:253: 20000000:01000000:0.0:1788390346.626591:0:6487:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788390346.626605:0:6487:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788390346.634509:0:6487:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788390346.634551:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788390346.634945:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:9483:x1875263097969408:12345-0@lo:253: Request processed in 8368us (8651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.634967:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 20000000:01000000:3.0:1788390346.635040:0:6508:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788390346.635045:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788390346.635063:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.635080:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be973bb expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.635087:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97401 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.635094:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.635132:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97401 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.635146:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97401 expref: 16 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390346.635159:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097969536:0@lo:104: 00000100:00100000:3.0:1788390346.635195:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390346.635242:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be973bb expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.635251:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be973bb expref: 16 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390346.635259:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097969664:0@lo:104: 00000100:00100000:3.0:1788390346.635288:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390346.635306:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390346.635381:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097969536 00000100:00100000:0.0:1788390346.635387:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097969536 00000100:00100000:0.0:1788390346.635415:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097969664 00000100:00100000:0.0:1788390346.635417:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097969664 00000100:00100000:0.0:1788390346.635429:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788390346.635437:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6508:x1875263097969536:12345-0@lo:104: 00010000:00010000:0.0:1788390346.635448:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635566:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390346.635572:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:6508:x1875263097969536:12345-0@lo:104: Request processed in 135us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.635578:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788390346.635593:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390346.635600:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6508:x1875263097969664:12345-0@lo:104: 00010000:00010000:0.0:1788390346.635607:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635638:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788390346.635642:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:6508:x1875263097969664:12345-0@lo:104: Request processed in 44us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.635648:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788390346.635665:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390346.635670:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635677:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390346.635681:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635700:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390346.635707:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390346.635713:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390346.635741:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635747:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390346.635765:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635773:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be97401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97408 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635785:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390346.635788:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635794:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cea00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390346.635797:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635804:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390346.635809:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390346.635821:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390346.635832:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635838:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390346.635843:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635850:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be973bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be973c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.635862:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390346.635863:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390346.635865:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390346.635871:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390346.635881:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097969792:0@lo:103: 00000100:00100000:0.0:1788390346.635908:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.635930:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390346.635936:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097969920:0@lo:103: 00000100:00100000:0.0:1788390346.635971:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390346.635996:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097969792 00000100:00100000:0.0:1788390346.636000:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097969792 00010000:00010000:0.0:1788390346.636017:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97401 expref: 17 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390346.636036:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097969920 00000100:00100000:0.0:1788390346.636038:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097969920 00010000:00010000:0.0:1788390346.636048:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be973bb expref: 18 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390346.636071:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788390346.636076:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:3624:x1875263097969792:12345-0@lo:103: 00010000:00010000:0.0:1788390346.636085:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390346.636089:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97401 expref: 18 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636099:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97401 expref: 18 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636112:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390346.636139:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:3624:x1875263097969792:12345-0@lo:103: Request processed in 63us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.636145:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788390346.636161:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390346.636167:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:3624:x1875263097969920:12345-0@lo:103: 00010000:00010000:0.0:1788390346.636174:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390346.636178:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be973bb expref: 17 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636188:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be973bb expref: 17 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636198:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636205:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788390346.636227:0:6479:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005419288s 00010000:00010000:0.0:1788390346.636232:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636239:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636245:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636252:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636257:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734200 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390346.636260:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636267:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636275:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390346.636285:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390346.636308:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:3624:x1875263097969920:12345-0@lo:103: Request processed in 141us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390346.636314:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390346.636386:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097969920:0@lo:103: 00000100:00100000:0.0:1788390346.636394:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097969792:0@lo:103: 00010000:00010000:3.0:1788390346.636482:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80030a00/0xe156d0713be97408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97401 expref: 16 pid: 6487 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390346.636493:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097969536:0@lo:104: 00010000:00010000:3.0:1788390346.636501:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cf200/0xe156d0713be973c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be973bb expref: 15 pid: 6486 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390346.636510:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875263097969664:0@lo:104: 00010000:00010000:3.0:1788390346.636524:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.636532:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.636539:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390346.636546:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf734200/0xe156d0713be974cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390346.636770:0:9483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bece9d-37f8-46e7-9f27-a320529bc20d:9483:1875263097969408:0@lo:253: 10000000:01000000:2.0:1788390346.636780:0:9483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788390346.636783:0:9483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788390346.636785:0:9483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788390346.636786:0:9483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390346.636788:0:9483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390346.636789:0:9483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390346.636791:0:9483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390346.636793:0:9483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788390346.636794:0:9483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788390346.636795:0:9483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788390346.636797:0:9483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390346.636799:0:9483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788390346.636809:0:9483:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788390346.641115:0:9483:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788390346.641277:0:9483:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788390346.641848:0:9483:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788390346.642018:0:9483:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788390346.642215:0:9483:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788390346.642668:0:9483:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788390346.643651:0:9483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788390346.651918:0:9483:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788390346.651930:0:9483:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788390346.651976:0:9483:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788390346.652015:0:9483:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788390346.652036:0:9483:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788390346.652054:0:9483:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788390346.652834:0:9483:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390346.653044:0:9483:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788390346.897504:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788390347.348966:0:9556:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788390347.349280:0:9556:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788390347.921530:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390348.370759:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390348.370781:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097970048:0@lo:41: 00000100:00100000:1.0:1788390348.370844:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390348.370886:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097970048 00000100:00100000:0.0:1788390348.370896:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097970048 00000100:00100000:0.0:1788390348.370965:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788390348.370975:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097970048:12345-0@lo:41: 00000004:00000024:0.0:1788390348.371008:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788390348.371054:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097970048:12345-0@lo:41: Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390348.371062:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788390348.371580:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097970048:0@lo:41: 00010000:00010000:3.0:1788390348.945620:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390349.971839:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390350.418573:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097970176:0@lo:13: 00000100:00100000:1.0:1788390350.418646:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390350.418723:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097970176 00000100:00100000:1.0:1788390350.418730:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097970176 00000100:00100000:1.0:1788390350.418784:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390350.418793:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097970176:12345-0@lo:13: 00002000:00000024:1.0:1788390350.418821:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390350.418867:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097970176:12345-0@lo:13: Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390350.418889:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788390350.418913:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788390350.418956:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb2a8380 x1875263097970176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390350.418975:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097970176:0@lo:13: 00000100:00100000:2.0:1788390350.419063:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390350.419073:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097970304:0@lo:41: 00000100:00100000:2.0:1788390350.419214:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390350.419316:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097970304 00000100:00100000:1.0:1788390350.419346:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097970304 00000100:00100000:1.0:1788390350.419376:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788390350.419384:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097970304:12345-0@lo:41: 00000004:00000024:1.0:1788390350.419409:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788390350.419458:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097970304:12345-0@lo:41: Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390350.419464:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788390350.419493:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097970304:0@lo:41: 00000100:00100000:3.0:1788390350.420628:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390350.420644:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097970432:0@lo:13: 00000100:00100000:3.0:1788390350.420687:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390350.420731:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097970432 00000100:00100000:3.0:1788390350.420736:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097970432 00000100:00100000:3.0:1788390350.420789:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390350.420796:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097970432:12345-0@lo:13: 00002000:00000024:3.0:1788390350.420811:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390350.420849:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097970432:12345-0@lo:13: Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390350.420855:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788390350.420875:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788390350.420897:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb21bb80 x1875263097970432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390350.420912:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097970432:0@lo:13: 00010000:00010000:3.0:1788390350.999468:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788390351.573712:0:9846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788390351.954344:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097970560:0@lo:400: 00000100:00100000:2.0:1788390351.954421:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954469:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097971072:0@lo:400: 00000100:00100000:2.0:1788390351.954495:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954513:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097971584:0@lo:400: 00000100:00100000:2.0:1788390351.954535:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954574:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788390351.954580:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097970688:0@lo:400: 00000100:00100000:2.0:1788390351.954602:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954617:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263097971200:0@lo:400: 00000100:00100000:2.0:1788390351.954633:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954648:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263097971712:0@lo:400: 00000100:00100000:2.0:1788390351.954670:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954697:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097970816:0@lo:400: 00000100:00100000:2.0:1788390351.954719:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954736:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263097971328:0@lo:400: 00000100:00100000:2.0:1788390351.954773:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954788:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263097971840:0@lo:400: 00000100:00100000:2.0:1788390351.954803:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954813:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788390351.954817:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263097970944:0@lo:400: 00000100:00100000:2.0:1788390351.954832:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954839:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097971456:0@lo:400: 00000100:00100000:2.0:1788390351.954854:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390351.954882:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097971072 00000100:00100000:2.0:1788390351.954888:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097971072 00000100:00100000:2.0:1788390351.954936:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097970816 00000100:00100000:2.0:1788390351.954939:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097970816 00000100:00100000:2.0:1788390351.954954:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788390351.954961:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097971072:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955011:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097971072:12345-0@lo:400: Request processed in 49us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955017:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788390351.955033:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788390351.955039:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097970816:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955070:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097970816:12345-0@lo:400: Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955075:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788390351.955095:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097971584 00000100:00100000:2.0:1788390351.955098:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097971584 00000100:00100000:2.0:1788390351.955122:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097971456 00000100:00100000:2.0:1788390351.955125:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097971456 00000100:00100000:2.0:1788390351.955142:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390351.955149:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097971584:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955188:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097971584:12345-0@lo:400: Request processed in 39us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955194:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390351.955206:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390351.955212:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097971456:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955236:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097971456:12345-0@lo:400: Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955242:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390351.955259:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097970688 00000100:00100000:2.0:1788390351.955262:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097970688 00000100:00100000:2.0:1788390351.955278:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097971200 00000100:00100000:2.0:1788390351.955280:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097971200 00000100:00100000:2.0:1788390351.955302:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097971712 00000100:00100000:2.0:1788390351.955305:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097971712 00000100:00100000:2.0:1788390351.955316:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097971328 00000100:00100000:2.0:1788390351.955318:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097971328 00000100:00100000:2.0:1788390351.955350:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097971840 00000100:00100000:2.0:1788390351.955353:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097971840 00000100:00100000:2.0:1788390351.955362:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097970944 00000100:00100000:2.0:1788390351.955365:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097970944 00000100:00100000:2.0:1788390351.955376:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788390351.955381:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097970688:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955410:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097970688:12345-0@lo:400: Request processed in 29us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955415:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788390351.955427:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788390351.955432:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263097971200:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955457:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263097971200:12345-0@lo:400: Request processed in 26us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955469:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788390351.955482:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788390351.955487:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263097971712:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955513:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263097971712:12345-0@lo:400: Request processed in 26us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955518:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788390351.955530:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788390351.955536:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263097971328:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955559:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263097971328:12345-0@lo:400: Request processed in 24us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955565:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788390351.955575:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788390351.955580:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263097971840:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955606:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263097971840:12345-0@lo:400: Request processed in 25us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955611:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788390351.955622:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788390351.955627:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263097970944:12345-0@lo:400: 00000100:00100000:2.0:1788390351.955652:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263097970944:12345-0@lo:400: Request processed in 26us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390351.955658:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788390351.955700:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788390351.955705:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788390351.955731:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741a680 x1875263097970944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390351.955758:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263097970944:0@lo:400: 00010000:00080000:2.0:1788390351.955772:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87418700 x1875263097971456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390351.955779:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097971456:0@lo:400: 00000100:00100000:2.0:1788390351.955787:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097970816:0@lo:400: 00010000:00080000:2.0:1788390351.955795:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87419180 x1875263097971328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390351.955802:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263097971328:0@lo:400: 00010000:00080000:2.0:1788390351.955809:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741b100 x1875263097971840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390351.955816:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263097971840:0@lo:400: 00010000:00080000:2.0:1788390351.955850:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741a300 x1875263097970688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390351.955859:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097970688:0@lo:400: 00010000:00080000:2.0:1788390351.955867:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87418000 x1875263097971200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390351.955874:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263097971200:0@lo:400: 00010000:00080000:2.0:1788390351.955882:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87419880 x1875263097971712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390351.955888:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263097971712:0@lo:400: 00000100:00100000:2.0:1788390351.955896:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097971072:0@lo:400: 00010000:00080000:2.0:1788390351.955930:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87419500 x1875263097971584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390351.955939:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097971584:0@lo:400: 00000100:00100000:1.0:1788390351.956574:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097970560 00000100:00100000:1.0:1788390351.956580:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097970560 00000100:00100000:1.0:1788390351.956622:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788390351.956630:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3622:x1875263097970560:12345-0@lo:400: 00000100:00100000:1.0:1788390351.956675:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:3622:x1875263097970560:12345-0@lo:400: Request processed in 45us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390351.956680:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788390351.960267:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097970560:0@lo:400: 00010000:00010000:0.0:1788390352.023345:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788390352.430786:0:9898:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390352.431007:0:9898:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788390353.041673:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390353.490071:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390353.490099:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097971968:0@lo:41: 00000100:00100000:3.0:1788390353.490245:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390353.490458:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097971968 00000100:00100000:0.0:1788390353.490468:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097971968 00000100:00100000:0.0:1788390353.490517:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788390353.490526:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097971968:12345-0@lo:41: 00000004:00000024:0.0:1788390353.490683:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788390353.490746:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097971968:12345-0@lo:41: Request processed in 220us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390353.490753:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788390353.490849:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097971968:0@lo:41: 00010000:00010000:0.0:1788390354.065691:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390355.090843:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788390355.108169:0:9999:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390355.108352:0:9999:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788390355.538582:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097972352:0@lo:41: 00000100:00100000:1.0:1788390355.538655:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390355.538697:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097972352 00000100:00100000:3.0:1788390355.538707:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097972352 00000100:00100000:3.0:1788390355.538812:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390355.538823:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097972352:12345-0@lo:41: 00000004:00000024:3.0:1788390355.538855:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788390355.538922:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097972352:12345-0@lo:41: Request processed in 102us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390355.538929:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390355.539488:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097972096:0@lo:13: 00000100:00100000:3.0:1788390355.539523:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390355.539556:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390355.539577:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097972224:0@lo:13: 00000100:00100000:3.0:1788390355.539600:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390355.539627:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097972096 00000100:00100000:3.0:1788390355.539631:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097972096 00000100:00100000:3.0:1788390355.539659:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097972224 00000100:00100000:3.0:1788390355.539662:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097972224 00000100:00100000:3.0:1788390355.539675:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390355.539681:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097972096:12345-0@lo:13: 00002000:00000024:3.0:1788390355.539700:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390355.539729:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097972096:12345-0@lo:13: Request processed in 49us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390355.539735:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390355.539745:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390355.539751:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097972224:12345-0@lo:13: 00002000:00000024:3.0:1788390355.539758:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390355.539775:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097972224:12345-0@lo:13: Request processed in 25us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390355.539780:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788390355.539794:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788390355.539817:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb2a8380 x1875263097972224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390355.539834:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097972224:0@lo:13: 00010000:00080000:3.0:1788390355.539843:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877c9880 x1875263097972096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390355.539853:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097972096:0@lo:13: 00000100:00100000:1.0:1788390355.541418:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097972352:0@lo:41: 00000020:00000004:2.0:1788390355.860742:0:10048:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390355.860753:0:10048:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 10000000:01000000:0.0:1788390356.049481:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788390356.049490:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fb7b73800 from 39 10000000:01000000:0.0:1788390356.049497:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788390356.049548:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390356.049560:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390356.049593:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390356.049619:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097972480:0@lo:101: 00000100:00100000:0.0:1788390356.049691:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.049761:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88304840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.049907:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097972480 00000100:00100000:2.0:1788390356.049919:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097972480 00000100:00100000:2.0:1788390356.049962:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788390356.049970:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097972480:12345-0@lo:101: 00010000:00010000:2.0:1788390356.049981:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390356.049991:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be974d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.050015:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be974d3 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.050023:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be974d3 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.050031:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5400, rc 0) 00000100:00100000:2.0:1788390356.050072:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097972480:12345-0@lo:101: Request processed in 103us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.050085:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788390356.050472:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097972480:0@lo:101: 00010000:00010000:0.0:1788390356.050492:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390356.050504:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390356.050563:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097972608:0@lo:501: 00000100:00100000:0.0:1788390356.050587:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.050611:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88304840 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.050660:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097972608 00000100:00100000:1.0:1788390356.050664:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097972608 00000100:00100000:1.0:1788390356.050695:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788390356.050701:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097972608:12345-0@lo:501: 00000100:00100000:1.0:1788390356.050810:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097972608:12345-0@lo:501: Request processed in 109us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.050815:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788390356.050926:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097972608:0@lo:501: 00000100:00100000:0.0:1788390356.051119:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097972736:0@lo:503: 00000100:00100000:0.0:1788390356.051152:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.051168:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88304840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.051190:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097972736 00000100:00100000:2.0:1788390356.051195:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097972736 00000100:00100000:2.0:1788390356.051230:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788390356.051237:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097972736:12345-0@lo:503: 00000100:00100000:2.0:1788390356.051532:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097972736:12345-0@lo:503: Request processed in 294us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.051539:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788390356.051645:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097972736:0@lo:503: 00000100:00100000:0.0:1788390356.052037:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10060:1875263097972864:0@lo:502: 00000100:00100000:0.0:1788390356.052078:0:10060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.052141:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88304600 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.052183:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097972864 00000100:00100000:2.0:1788390356.052188:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097972864 00000100:00100000:2.0:1788390356.052258:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788390356.052266:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:10060:x1875263097972864:12345-0@lo:502: 00000100:00100000:2.0:1788390356.052387:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:10060:x1875263097972864:12345-0@lo:502: Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.052394:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788390356.052453:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10060:1875263097972864:0@lo:502: 00000100:00100000:0.0:1788390356.052496:0:10060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10060:1875263097972992:0@lo:502: 00000100:00100000:0.0:1788390356.052524:0:10060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.052719:0:10060:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b99840 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.052904:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097972992 00000100:00100000:1.0:1788390356.052908:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097972992 00000100:00100000:1.0:1788390356.052932:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788390356.052938:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:10060:x1875263097972992:12345-0@lo:502: 00000100:00100000:1.0:1788390356.053055:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:10060:x1875263097972992:12345-0@lo:502: Request processed in 117us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.053061:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788390356.053169:0:10060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10060:1875263097972992:0@lo:502: 00000040:00080000:0.0:1788390356.053186:0:10060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788390356.053544:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788390356.053570:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788390356.053581:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.053592:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390356.053601:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788390356.053604:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788390356.053607:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788390356.053632:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.053650:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.053660:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390356.053675:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973120:0@lo:101: 00000100:00100000:2.0:1788390356.053705:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.053769:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.053806:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097973120 00000100:00100000:1.0:1788390356.053811:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097973120 00000100:00100000:1.0:1788390356.053884:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788390356.053892:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097973120:12345-0@lo:101: 00010000:00010000:1.0:1788390356.053901:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390356.053914:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be974e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.053935:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be974e1 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.053945:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be974e1 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.053965:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cf800, rc 0) 00000100:00100000:1.0:1788390356.054004:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097973120:12345-0@lo:101: Request processed in 113us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.054010:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788390356.054063:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973120:0@lo:101: 00010000:00010000:0.0:1788390356.054076:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390356.054085:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390356.054129:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973248:0@lo:501: 00000100:00100000:0.0:1788390356.054153:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.054237:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b99840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.054301:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097973248 00000100:00100000:2.0:1788390356.054305:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097973248 00000100:00100000:2.0:1788390356.054349:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788390356.054356:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097973248:12345-0@lo:501: 00000100:00100000:2.0:1788390356.054457:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097973248:12345-0@lo:501: Request processed in 102us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.054463:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788390356.054592:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973248:0@lo:501: 00000100:00100000:0.0:1788390356.054614:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973376:0@lo:503: 00000100:00100000:0.0:1788390356.054647:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.054662:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b99840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.054701:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097973376 00000100:00100000:2.0:1788390356.054704:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097973376 00000100:00100000:2.0:1788390356.054719:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788390356.054724:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097973376:12345-0@lo:503: 00000100:00100000:2.0:1788390356.054794:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097973376:12345-0@lo:503: Request processed in 69us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.054800:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788390356.054861:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973376:0@lo:503: 00000100:00100000:0.0:1788390356.055179:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10061:1875263097973504:0@lo:502: 00000100:00100000:0.0:1788390356.055211:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.055233:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b99540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.055278:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097973504 00000100:00100000:2.0:1788390356.055282:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097973504 00000100:00100000:2.0:1788390356.055300:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788390356.055305:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:10061:x1875263097973504:12345-0@lo:502: 00000100:00100000:2.0:1788390356.055474:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:10061:x1875263097973504:12345-0@lo:502: Request processed in 167us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.055480:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788390356.055568:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10061:1875263097973504:0@lo:502: 00000020:01000000:0.0:1788390356.055596:0:10061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390356.055605:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390356.055607:0:10061:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390356.055612:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390356.055614:0:10061:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788390356.055628:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10061:1875263097973632:0@lo:502: 00000100:00100000:0.0:1788390356.055657:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.055674:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b99540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.055717:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097973632 00000100:00100000:2.0:1788390356.055721:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097973632 00000100:00100000:2.0:1788390356.055739:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788390356.055745:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:10061:x1875263097973632:12345-0@lo:502: 00000100:00100000:2.0:1788390356.055803:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:10061:x1875263097973632:12345-0@lo:502: Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.055810:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788390356.055867:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10061:1875263097973632:0@lo:502: 00000020:01000000:0.0:1788390356.055894:0:10061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390356.055898:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390356.055899:0:10061:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788390356.055902:0:10061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788390356.056137:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788390356.056155:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788390356.056163:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.056173:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390356.056182:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788390356.056184:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fb76a1000 from 39 10000000:01000000:2.0:1788390356.056187:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788390356.056207:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.056215:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.056224:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390356.056244:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973760:0@lo:101: 00000100:00100000:2.0:1788390356.056266:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.056315:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390356.056462:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097973760 00000100:00100000:3.0:1788390356.056471:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097973760 00000100:00100000:1.0:1788390356.056529:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788390356.056538:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097973760:12345-0@lo:101: 00010000:00010000:1.0:1788390356.056545:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390356.056556:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be974ef expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.056574:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be974ef expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.056583:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be974ef expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.056591:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cf600, rc 0) 00000100:00100000:1.0:1788390356.056624:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097973760:12345-0@lo:101: Request processed in 89us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.056629:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788390356.056686:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973760:0@lo:101: 00010000:00010000:0.0:1788390356.056697:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390356.056706:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390356.056745:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973888:0@lo:501: 00000100:00100000:0.0:1788390356.056768:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.056792:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b99540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.056828:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097973888 00000100:00100000:1.0:1788390356.056831:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097973888 00000100:00100000:1.0:1788390356.056858:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788390356.056863:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097973888:12345-0@lo:501: 00000100:00100000:1.0:1788390356.056952:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097973888:12345-0@lo:501: Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.056958:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788390356.057027:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097973888:0@lo:501: 00000100:00100000:0.0:1788390356.057050:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974016:0@lo:503: 00000100:00100000:0.0:1788390356.057081:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.057101:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b99540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.057151:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097974016 00000100:00100000:1.0:1788390356.057155:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097974016 00000100:00100000:1.0:1788390356.057181:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788390356.057187:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097974016:12345-0@lo:503: 00000100:00100000:1.0:1788390356.057257:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097974016:12345-0@lo:503: Request processed in 70us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.057263:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788390356.057300:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974016:0@lo:503: 00000100:00100000:0.0:1788390356.057715:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10062:1875263097974144:0@lo:502: 00000100:00100000:0.0:1788390356.057753:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.057782:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.057825:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097974144 00000100:00100000:1.0:1788390356.057831:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097974144 00000100:00100000:1.0:1788390356.057861:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788390356.057868:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:10062:x1875263097974144:12345-0@lo:502: 00000100:00100000:1.0:1788390356.057951:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:10062:x1875263097974144:12345-0@lo:502: Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.057957:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788390356.058028:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10062:1875263097974144:0@lo:502: 00000100:00100000:0.0:1788390356.058066:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10062:1875263097974272:0@lo:502: 00000100:00100000:0.0:1788390356.058096:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.058118:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.058161:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097974272 00000100:00100000:1.0:1788390356.058165:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097974272 00000100:00100000:1.0:1788390356.058192:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788390356.058198:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:10062:x1875263097974272:12345-0@lo:502: 00000100:00100000:1.0:1788390356.058256:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:10062:x1875263097974272:12345-0@lo:502: Request processed in 58us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.058262:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788390356.058360:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10062:1875263097974272:0@lo:502: 00000040:00080000:0.0:1788390356.058387:0:10062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788390356.058624:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788390356.058644:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390356.058652:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.058673:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390356.058682:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788390356.058685:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984fb76a1000 from 6 10000000:01000000:1.0:1788390356.058688:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788390356.058711:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.058718:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.058727:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390356.058739:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974400:0@lo:101: 00000100:00100000:1.0:1788390356.058765:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.058794:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f8302a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390356.058841:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097974400 00000100:00100000:0.0:1788390356.058845:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097974400 00000100:00100000:0.0:1788390356.058885:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788390356.058892:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097974400:12345-0@lo:101: 00010000:00010000:0.0:1788390356.058900:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390356.058912:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f80031e00/0xe156d0713be97504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be974fd expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390356.058931:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f80031e00/0xe156d0713be97504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be974fd expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390356.058940:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f80031e00/0xe156d0713be97504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be974fd expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390356.058948:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f80031e00, rc 0) 00000100:00100000:0.0:1788390356.058991:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097974400:12345-0@lo:101: Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390356.058997:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788390356.059072:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974400:0@lo:101: 00010000:00010000:2.0:1788390356.059084:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.059093:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390356.059133:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974528:0@lo:256: 00000100:00100000:2.0:1788390356.059159:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.059178:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390356.059219:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097974528 00000100:00100000:0.0:1788390356.059223:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097974528 00000100:00100000:0.0:1788390356.059238:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788390356.059242:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097974528:12345-0@lo:256: 20000000:01000000:0.0:1788390356.059253:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390356.059267:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390356.059270:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788390356.059441:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097974528:12345-0@lo:256: Request processed in 197us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390356.059447:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788390356.059512:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974528:0@lo:256: 10000000:01000000:2.0:1788390356.059550:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788390356.059555:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.059562:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390356.059570:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788390356.059571:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788390356.059573:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788390356.059585:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.059601:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.059609:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390356.059619:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974656:0@lo:101: 00000100:00100000:2.0:1788390356.059639:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.059663:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.059729:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097974656 00000100:00100000:1.0:1788390356.059733:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097974656 00000100:00100000:1.0:1788390356.059750:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788390356.059755:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097974656:12345-0@lo:101: 00010000:00010000:1.0:1788390356.059761:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390356.059770:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9750b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.059784:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9750b expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.059802:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9750b expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.059808:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cfa00, rc 0) 00000100:00100000:1.0:1788390356.059833:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097974656:12345-0@lo:101: Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.059839:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788390356.059862:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974656:0@lo:101: 00010000:00010000:1.0:1788390356.059885:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.059893:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390356.059946:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974784:0@lo:501: 00000100:00100000:1.0:1788390356.059968:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.059981:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f831d9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.059992:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097974784 00000100:00100000:1.0:1788390356.059995:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097974784 00000100:00100000:1.0:1788390356.060011:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788390356.060017:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097974784:12345-0@lo:501: 00000100:00100000:1.0:1788390356.060112:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097974784:12345-0@lo:501: Request processed in 94us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.060118:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788390356.060144:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974784:0@lo:501: 00000100:00100000:1.0:1788390356.060167:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974912:0@lo:503: 00000100:00100000:1.0:1788390356.060198:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.060210:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f831d9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.060219:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097974912 00000100:00100000:1.0:1788390356.060222:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097974912 00000100:00100000:1.0:1788390356.060235:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788390356.060240:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097974912:12345-0@lo:503: 00000100:00100000:1.0:1788390356.060303:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097974912:12345-0@lo:503: Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.060308:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788390356.060809:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097974912:0@lo:503: 00000100:00100000:0.0:1788390356.061222:0:10063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10063:1875263097975040:0@lo:502: 00000100:00100000:0.0:1788390356.061262:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.061359:0:10063:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90682240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.061503:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097975040 00000100:00100000:1.0:1788390356.061509:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097975040 00000100:00100000:1.0:1788390356.061581:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788390356.061589:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:10063:x1875263097975040:12345-0@lo:502: 00000100:00100000:1.0:1788390356.061693:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:10063:x1875263097975040:12345-0@lo:502: Request processed in 104us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.061700:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788390356.061764:0:10063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10063:1875263097975040:0@lo:502: 00000020:01000000:0.0:1788390356.061785:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788390356.061792:0:10063:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788390356.061799:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390356.061802:0:10063:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788390356.061807:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788390356.061811:0:10063:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:01000000:0.0:1788390356.061836:0:10063:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788390356.061839:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788390356.061854:0:10063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff984fbac43370) 00000020:00000080:0.0:1788390356.061891:0:10063:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788390356.061898:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788390356.061982:0:10063:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788390356.061989:0:10063:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788390356.061995:0:10063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be97520 00010000:00080000:0.0:1788390356.062025:0:10063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984f89f62000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.111@tcp at head 00010000:00010000:0.0:1788390356.062251:0:10063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788390356.062499:0:10063:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788390356.062512:0:10063:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788390356.062686:0:10063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390356.062801:0:10063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390356.062953:0:10063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788390356.063034:0:10063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788390356.063932:0:10064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390356.063937:0:10064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788390356.064689:0:10063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788390356.064700:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788390356.064740:0:10063:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788390356.064763:0:10063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be97527 00000100:00080000:2.0:1788390356.064773:0:10063:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390356.064778:0:10063:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff984f89f62000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390356.064813:0:10063:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984fbb28e300 x1875263097975168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390356.064885:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263097975168:0@lo:8: 00000100:00100000:1.0:1788390356.064952:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788390356.065061:0:10063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788390356.065120:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390356.065124:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390356.065126:0:10063:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788390356.065129:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390356.065132:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390356.065134:0:10063:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788390356.065137:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788390356.065138:0:10063:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788390356.065161:0:10063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10063:1875263097975296:0@lo:502: 00000100:00100000:2.0:1788390356.065205:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.065229:0:10063:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390356.065483:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097975168 00000100:00100000:3.0:1788390356.065492:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097975168 00000100:00100000:3.0:1788390356.065531:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390356.065539:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1875263097975168:12345-0@lo:8: 00010000:00080000:3.0:1788390356.065566:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1788390356.065592:0:8408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be9752e 00002000:00100000:3.0:1788390356.065608:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff984fc18fb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788390356.065612:0:8408:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788390356.065617:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788390356.065670:0:8408:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788390356.065865:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788390356.065898:0:8408:0:(import.c:65:import_set_state_nolock()) ffff984fc18fc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390356.065979:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097975424:0@lo:400: 00000100:00100000:2.0:1788390356.066009:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.066027:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263097975936:0@lo:400: 00000100:00100000:2.0:1788390356.066045:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.066061:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390356.066066:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263097975808:0@lo:400: 00000100:00100000:2.0:1788390356.066083:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.066105:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263097975680:0@lo:400: 00000100:00100000:2.0:1788390356.066127:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.066142:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263097976192:0@lo:400: 00000100:00100000:2.0:1788390356.066159:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.066168:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788390356.066173:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097975552:0@lo:400: 00000100:00100000:2.0:1788390356.066193:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.066210:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263097976064:0@lo:400: 00000100:00100000:2.0:1788390356.066229:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.066249:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097975424 00000100:00100000:2.0:1788390356.066253:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097975424 00000100:00100000:2.0:1788390356.066277:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097975936 00000100:00100000:2.0:1788390356.066279:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097975936 00000100:00100000:2.0:1788390356.066300:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097975808 00000100:00100000:2.0:1788390356.066302:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097975808 00000100:00100000:2.0:1788390356.066312:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097975680 00000100:00100000:2.0:1788390356.066315:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097975680 00000100:00100000:2.0:1788390356.066351:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097976192 00000100:00100000:2.0:1788390356.066354:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097976192 00000100:00100000:2.0:1788390356.066377:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097976064 00000100:00100000:2.0:1788390356.066381:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097976064 00000100:00100000:2.0:1788390356.066408:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788390356.066414:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097975424:12345-0@lo:400: 00000100:00100000:2.0:1788390356.066452:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097975424:12345-0@lo:400: Request processed in 38us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.066460:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788390356.066476:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788390356.066482:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263097975936:12345-0@lo:400: 00000100:00100000:2.0:1788390356.066506:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263097975936:12345-0@lo:400: Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.066512:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788390356.066523:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788390356.066529:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263097975808:12345-0@lo:400: 00000100:00100000:2.0:1788390356.066566:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263097975808:12345-0@lo:400: Request processed in 38us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.066572:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788390356.066583:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390356.066588:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263097975680:12345-0@lo:400: 00000100:00100000:2.0:1788390356.066617:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263097975680:12345-0@lo:400: Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.066623:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390356.066634:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788390356.066639:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875263097976192:12345-0@lo:400: 00000100:00100000:2.0:1788390356.066662:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875263097976192:12345-0@lo:400: Request processed in 23us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.066667:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788390356.066676:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390356.066686:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263097976064:12345-0@lo:400: 00000100:00100000:2.0:1788390356.066711:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263097976064:12345-0@lo:400: Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.066716:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390356.066745:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097975552 00000100:00100000:2.0:1788390356.066749:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097975552 00000100:00100000:2.0:1788390356.066774:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788390356.066780:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097975552:12345-0@lo:400: 00000100:00100000:2.0:1788390356.066809:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097975552:12345-0@lo:400: Request processed in 30us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.066814:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788390356.066847:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877cad80 x1875263097975808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.066860:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263097975808:0@lo:400: 00010000:00080000:2.0:1788390356.066884:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877c8380 x1875263097975424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.066893:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097975424:0@lo:400: 00010000:00080000:2.0:1788390356.066902:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877cbb80 x1875263097975936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.066910:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263097975936:0@lo:400: 00000100:00100000:2.0:1788390356.066936:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097975552:0@lo:400: 00010000:00080000:2.0:1788390356.066945:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877c9f80 x1875263097976064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.066953:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263097976064:0@lo:400: 00010000:00080000:2.0:1788390356.066971:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877cb480 x1875263097975680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.066979:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263097975680:0@lo:400: 00010000:00080000:2.0:1788390356.066988:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877c8a80 x1875263097976192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.066995:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263097976192:0@lo:400: 00000100:00100000:3.0:1788390356.067358:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1875263097975168:12345-0@lo:8: Request processed in 1818us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390356.067550:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788390356.067575:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390356.067579:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788390356.067684:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb28e300 x1875263097975168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390356.067694:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390356.067702:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788390356.067710:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788390356.067715:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788390356.067718:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f89f62000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788390356.067745:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788390356.067751:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263097975168:0@lo:8: 00000100:00100000:1.0:1788390356.067779:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097975296 00000100:00100000:1.0:1788390356.067783:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097975296 00000100:00100000:1.0:1788390356.067809:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788390356.067816:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:10063:x1875263097975296:12345-0@lo:502: 00000100:00100000:1.0:1788390356.067946:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:10063:x1875263097975296:12345-0@lo:502: Request processed in 130us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.067953:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788390356.068040:0:10063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10063:1875263097975296:0@lo:502: 00000020:01000000:2.0:1788390356.068066:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390356.068074:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390356.068077:0:10063:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788390356.068081:0:10063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1788390356.068226:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875263097976320:0@lo:700: 00000100:00100000:2.0:1788390356.068260:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.068285:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097976320 00000100:00100000:2.0:1788390356.068288:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097976320 00000100:00100000:2.0:1788390356.068342:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390356.068350:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10065:x1875263097976320:12345-0@lo:700: 00000100:00100000:2.0:1788390356.068388:0:8416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8416:1875263097976448:0@lo:700: 00000100:00100000:2.0:1788390356.068414:0:8416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.068431:0:8416:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.068447:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097976448 00000100:00100000:2.0:1788390356.068449:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097976448 00000100:00100000:2.0:1788390356.068473:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390356.068479:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8416:x1875263097976448:12345-0@lo:700: 00000100:00100000:2.0:1788390356.068615:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb76c0 going to sleep for 11 seconds 00000020:01000000:1.0:1788390356.068732:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788390356.068753:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788390356.068761:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.068772:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390356.068782:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788390356.068785:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984f988e6800 from 39 10000000:01000000:1.0:1788390356.068788:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788390356.068814:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.068821:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.068830:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390356.068841:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097976576:0@lo:101: 00000100:00100000:1.0:1788390356.068889:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.068922:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef4c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.068969:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097976576 00000100:00100000:2.0:1788390356.068974:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097976576 00000100:00100000:2.0:1788390356.069004:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788390356.069011:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097976576:12345-0@lo:101: 00010000:00010000:2.0:1788390356.069019:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390356.069032:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97535 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.069054:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97535 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.069064:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97535 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.069072:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5600, rc 0) 00000100:00100000:2.0:1788390356.069101:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097976576:12345-0@lo:101: Request processed in 90us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.069107:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00080000:3.0:1788390356.069180:0:10064:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788390356.069234:0:10064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 176626912242ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788390356.069241:0:10064:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:3.0:1788390356.069268:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788390356.070747:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788390356.070913:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097976576:0@lo:101: 00010000:00010000:1.0:1788390356.070932:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390356.070943:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390356.071006:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097976704:0@lo:501: 00000100:00100000:1.0:1788390356.071050:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.071086:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef4c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.071133:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097976704 00000100:00100000:2.0:1788390356.071139:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097976704 00000100:00100000:2.0:1788390356.071177:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788390356.071185:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097976704:12345-0@lo:501: 00000100:00100000:2.0:1788390356.071823:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097976704:12345-0@lo:501: Request processed in 637us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.071831:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788390356.071917:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097976704:0@lo:501: 00000100:00100000:1.0:1788390356.071949:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097976832:0@lo:503: 00000100:00100000:1.0:1788390356.071995:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.072028:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef4c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.072134:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097976832 00000100:00100000:2.0:1788390356.072139:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097976832 00000100:00100000:2.0:1788390356.072177:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788390356.072193:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097976832:12345-0@lo:503: 00000100:00100000:2.0:1788390356.072278:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097976832:12345-0@lo:503: Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.072284:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788390356.072397:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097976832:0@lo:503: 40000000:02000000:3.0:1788390356.073934:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1788390356.075712:0:10066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10066:1875263097976960:0@lo:502: 00000100:00100000:1.0:1788390356.075799:0:10066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.075890:0:10066:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef4c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.078194:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097976960 00000100:00100000:2.0:1788390356.078206:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097976960 00000100:00100000:2.0:1788390356.078297:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788390356.078307:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10066:x1875263097976960:12345-0@lo:502: 00000100:00100000:2.0:1788390356.078484:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10066:x1875263097976960:12345-0@lo:502: Request processed in 177us (2684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.078492:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788390356.078630:0:10066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10066:1875263097976960:0@lo:502: 00000100:00100000:1.0:1788390356.078688:0:10066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10066:1875263097977088:0@lo:502: 00000100:00100000:1.0:1788390356.078725:0:10066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.078749:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097977088 00000100:00100000:1.0:1788390356.078752:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097977088 00000100:00100000:1.0:1788390356.078783:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788390356.078789:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10066:x1875263097977088:12345-0@lo:502: 00000100:00100000:1.0:1788390356.078847:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10066:x1875263097977088:12345-0@lo:502: Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.078853:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788390356.078903:0:10066:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef4c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.078913:0:10066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10066:1875263097977088:0@lo:502: 00000040:00080000:1.0:1788390356.078930:0:10066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:3.0:1788390356.079810:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8416:x1875263097976448:12345-0@lo:700: Request processed in 11327us (11392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390356.079820:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788390356.079987:0:8416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741b800 x1875263097976448/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788390372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390356.080001:0:8416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8416:1875263097976448:0@lo:700: 40000000:02000000:1.0:1788390356.080011:0:8416:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:01000000:3.0:1788390356.084026:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788390356.084064:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788390356.084089:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.084101:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390356.084111:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390356.084114:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984f988e6800 from 6 10000000:01000000:3.0:1788390356.084117:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390356.084153:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.084161:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.084172:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390356.084194:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977216:0@lo:101: 00000100:00100000:3.0:1788390356.084259:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390356.084297:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37900 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.084399:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097977216 00000100:00100000:2.0:1788390356.084408:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097977216 00000100:00100000:2.0:1788390356.084465:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788390356.084475:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097977216:12345-0@lo:101: 00010000:00010000:2.0:1788390356.084488:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390356.084501:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4200/0xe156d0713be9754a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97543 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.084524:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4200/0xe156d0713be9754a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97543 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.084534:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4200/0xe156d0713be9754a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97543 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.084543:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4200, rc 0) 00000100:00100000:2.0:1788390356.084580:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097977216:12345-0@lo:101: Request processed in 107us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.084596:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788390356.084729:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977216:0@lo:101: 00010000:00010000:3.0:1788390356.084743:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.084753:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390356.084798:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977344:0@lo:256: 00000100:00100000:3.0:1788390356.084839:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390356.084860:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37900 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.084912:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097977344 00000100:00100000:2.0:1788390356.084917:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097977344 00000100:00100000:2.0:1788390356.084946:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788390356.084952:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097977344:12345-0@lo:256: 20000000:01000000:2.0:1788390356.084965:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788390356.084980:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788390356.084983:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788390356.085057:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097977344:12345-0@lo:256: Request processed in 104us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.085064:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788390356.085126:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977344:0@lo:256: 10000000:01000000:3.0:1788390356.085170:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390356.085175:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.085183:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390356.085189:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788390356.085191:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788390356.085193:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788390356.085208:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.085214:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.085222:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390356.085232:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977472:0@lo:101: 00000100:00100000:3.0:1788390356.085255:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390356.085273:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37900 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.085315:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097977472 00000100:00100000:2.0:1788390356.085444:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097977472 00000100:00100000:2.0:1788390356.085508:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788390356.085515:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097977472:12345-0@lo:101: 00010000:00010000:2.0:1788390356.085522:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390356.085531:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97551 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.085546:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97551 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.085555:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97551 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390356.085563:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4400, rc 0) 00000100:00100000:2.0:1788390356.085592:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097977472:12345-0@lo:101: Request processed in 78us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.085608:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788390356.085747:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977472:0@lo:101: 00010000:00010000:3.0:1788390356.085758:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.085777:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390356.085837:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977600:0@lo:501: 00000100:00100000:3.0:1788390356.085862:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390356.085903:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390356.085944:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097977600 00000100:00100000:0.0:1788390356.085948:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097977600 00000100:00100000:0.0:1788390356.085970:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788390356.085977:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097977600:12345-0@lo:501: 00000100:00100000:0.0:1788390356.086100:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097977600:12345-0@lo:501: Request processed in 123us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390356.086106:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788390356.086171:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977600:0@lo:501: 00000100:00100000:3.0:1788390356.086195:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977728:0@lo:503: 00000100:00100000:3.0:1788390356.086228:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390356.086247:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390356.086281:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097977728 00000100:00100000:0.0:1788390356.086285:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097977728 00000100:00100000:0.0:1788390356.086300:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788390356.086305:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097977728:12345-0@lo:503: 00000100:00100000:0.0:1788390356.086419:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097977728:12345-0@lo:503: Request processed in 113us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390356.086425:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788390356.086456:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097977728:0@lo:503: 00000100:00100000:0.0:1788390356.086624:0:10067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10067:1875263097977856:0@lo:502: 00000100:00100000:0.0:1788390356.086653:0:10067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.086670:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097977856 00000100:00100000:0.0:1788390356.086674:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097977856 00000100:00100000:0.0:1788390356.086694:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788390356.086699:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10067:x1875263097977856:12345-0@lo:502: 00000100:00100000:0.0:1788390356.086759:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10067:x1875263097977856:12345-0@lo:502: Request processed in 59us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390356.086766:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788390356.086795:0:10067:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f99dc7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390356.086806:0:10067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10067:1875263097977856:0@lo:502: 00000020:01000000:0.0:1788390356.086827:0:10067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788390356.086835:0:10067:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788390356.086842:0:10067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390356.086845:0:10067:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788390356.086849:0:10067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788390356.086853:0:10067:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:01000000:0.0:1788390356.086888:0:10067:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788390356.086892:0:10067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788390356.086907:0:10067:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff984fbac44d28) 00000020:00000080:0.0:1788390356.086935:0:10067:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788390356.086941:0:10067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788390356.087006:0:10067:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788390356.087011:0:10067:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788390356.087017:0:10067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be97566 00010000:00080000:0.0:1788390356.087045:0:10067:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984fc19ab800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.111@tcp at head 00010000:00010000:0.0:1788390356.087278:0:10067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788390356.087426:0:10067:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788390356.087438:0:10067:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788390356.087589:0:10067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390356.087707:0:10067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390356.087836:0:10067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788390356.087947:0:10067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788390356.088191:0:10068:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390356.088196:0:10068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788390356.089781:0:10067:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390356.089795:0:10067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788390356.089833:0:10067:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788390356.089856:0:10067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be9756d 00000100:00080000:1.0:1788390356.089866:0:10067:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390356.089886:0:10067:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984fc19ab800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390356.089919:0:10067:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984fbb2a8380 x1875263097977984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390356.089948:0:10067:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788390356.089996:0:10067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390356.090000:0:10067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390356.090002:0:10067:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788390356.090005:0:10067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390356.090008:0:10067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390356.090010:0:10067:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788390356.090020:0:10067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788390356.090022:0:10067:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788390356.090049:0:10067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10067:1875263097978112:0@lo:502: 00000100:00100000:1.0:1788390356.090125:0:10067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.090162:0:10067:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef4cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.090182:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097978112 00000100:00100000:1.0:1788390356.090188:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097978112 00000100:00100000:1.0:1788390356.090226:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788390356.090235:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10067:x1875263097978112:12345-0@lo:502: 00000100:00100000:1.0:1788390356.090362:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10067:x1875263097978112:12345-0@lo:502: Request processed in 127us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390356.090470:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263097977984:0@lo:8: 00000100:00100000:3.0:1788390356.090507:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390356.090641:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097977984 00000100:00100000:3.0:1788390356.090645:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097977984 00000100:00100000:3.0:1788390356.090668:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390356.090674:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3621:x1875263097977984:12345-0@lo:8: 00010000:00080000:3.0:1788390356.090698:0:8798:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1788390356.090724:0:8798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be97574 00002000:00100000:3.0:1788390356.090739:0:8798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff984fc18f8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788390356.090744:0:8798:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788390356.090747:0:8798:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788390356.090812:0:8798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788390356.090835:0:8798:0:(import.c:65:import_set_state_nolock()) ffff984fc18f8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390356.090890:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3621:x1875263097977984:12345-0@lo:8: Request processed in 215us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390356.090904:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788390356.090940:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb2a8380 x1875263097977984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390356.090951:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788390356.090958:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788390356.090966:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788390356.090970:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788390356.090973:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc19ab800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788390356.090987:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788390356.090993:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263097977984:0@lo:8: 00000100:00100000:1.0:1788390356.091248:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000004:00080000:2.0:1788390356.092540:0:10068:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788390356.093105:0:10067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10067:1875263097978112:0@lo:502: 00000020:01000000:1.0:1788390356.093147:0:10067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390356.093154:0:10067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390356.093157:0:10067:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788390356.093162:0:10067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1788390356.093659:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1788390356.093689:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788390356.093701:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.093713:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390356.093725:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788390356.093728:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984f88c4cd28 from 1 10000000:01000000:3.0:1788390356.093730:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788390356.093768:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.093776:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.093786:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390356.093813:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097978240:0@lo:101: 00000100:00100000:3.0:1788390356.093893:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390356.093931:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390356.093950:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097978240 00000100:00100000:3.0:1788390356.093958:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097978240 00000100:00100000:3.0:1788390356.093999:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788390356.094007:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097978240:12345-0@lo:101: 00010000:00010000:3.0:1788390356.094020:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390356.094031:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9757b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.094051:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9757b expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.094060:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9757b expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.094068:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735a00, rc 0) 00000100:00100000:3.0:1788390356.094097:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097978240:12345-0@lo:101: Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390356.094102:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788390356.094129:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097978240:0@lo:101: 00010000:00010000:3.0:1788390356.094140:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.094149:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390356.094206:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097978368:0@lo:501: 00000100:00100000:3.0:1788390356.094229:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390356.094242:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390356.094257:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097978368 00000100:00100000:3.0:1788390356.094260:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097978368 00000100:00100000:3.0:1788390356.094276:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788390356.094281:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097978368:12345-0@lo:501: 00000100:00100000:3.0:1788390356.094375:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097978368:12345-0@lo:501: Request processed in 86us (138us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390356.094382:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788390356.094402:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097978368:0@lo:501: 10000000:01000000:3.0:1788390356.094422:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788390356.094428:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390356.094434:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390356.094814:0:10068:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 176652490877ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788390356.094822:0:10068:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788390356.095216:0:10069:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788390356.095235:0:10069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10069:1875263097978624:0@lo:7: 00000100:00100000:0.0:1788390356.095276:0:10069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.095301:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097978624 00000100:00100000:0.0:1788390356.095305:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097978624 00000100:00100000:0.0:1788390356.095376:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788390356.095383:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10069:x1875263097978624:12345-0@lo:7: 00002000:00080000:0.0:1788390356.098571:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788390356.098581:0:8407:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788390356.098663:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10069:x1875263097978624:12345-0@lo:7: Request processed in 3277us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390356.098673:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788390356.098719:0:10069:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b2300 going to sleep for 11 seconds 00010000:00080000:0.0:1788390356.098747:0:10069:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877c9880 x1875263097978624/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788390372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390356.098762:0:10069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10069:1875263097978624:0@lo:7: 00000004:00080000:0.0:1788390356.098777:0:10069:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788390356.098816:0:10069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10069:1875263097978752:0@lo:5: 00000100:00100000:0.0:1788390356.098848:0:10069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.099074:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097978496:0@lo:13: 00000100:00100000:1.0:1788390356.099110:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.099151:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097978496 00000100:00100000:1.0:1788390356.099158:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097978496 00000100:00100000:1.0:1788390356.099198:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788390356.099207:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263097978496:12345-0@lo:13: 00002000:00000024:1.0:1788390356.099231:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1788390356.099266:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263097978496:12345-0@lo:13: Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.099272:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788390356.099300:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877cb100 x1875263097978496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390356.099351:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097978496:0@lo:13: 00000001:00100000:2.0:1788390356.099564:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788390356.099677:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10065:x1875263097976320:12345-0@lo:700: Request processed in 31327us (31415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.099689:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788390356.099751:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741b100 x1875263097976320/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788390372 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.099762:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875263097976320:0@lo:700: 00000100:00100000:0.0:1788390356.099902:0:10069:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788390356.100002:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097978752 00000100:00100000:3.0:1788390356.100006:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097978752 00000100:00100000:3.0:1788390356.100074:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390356.100083:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10069:x1875263097978752:12345-0@lo:5: 00002000:00080000:3.0:1788390356.100104:0:8798:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788390356.100108:0:8798:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00080000:0.0:1788390356.100395:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788390356.102281:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00080000:3.0:1788390356.103273:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788390356.103295:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788390356.103616:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10069:x1875263097978752:12345-0@lo:5: Request processed in 3529us (4762us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788390356.103627:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788390356.103716:0:10069:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877c9880 x1875263097978752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.103728:0:10069:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788390356.103735:0:10069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10069:1875263097978752:0@lo:5: 00000004:00080000:2.0:1788390356.103750:0:10069:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788390356.103798:0:10069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10069:1875263097978880:0@lo:700: 00000100:00100000:2.0:1788390356.103834:0:10069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.103863:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097978880 00000100:00100000:2.0:1788390356.103882:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097978880 00000100:00100000:2.0:1788390356.103933:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390356.103941:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10069:x1875263097978880:12345-0@lo:700: 00000100:00100000:2.0:1788390356.104061:0:10069:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.113015:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10069:x1875263097978880:12345-0@lo:700: Request processed in 9063us (9169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390356.113031:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788390356.113107:0:10069:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741b100 x1875263097978880/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788390372 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390356.113140:0:10069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10069:1875263097978880:0@lo:700: 00010000:00010000:1.0:1788390356.114353:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1788390356.115924:0:10069:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1788390356.119161:0:10069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10069:1875263097979008:0@lo:5: 00000100:00100000:1.0:1788390356.119230:0:10069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390356.119272:0:10069:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390356.119352:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097979008 00000100:00100000:3.0:1788390356.119359:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097979008 00000100:00100000:3.0:1788390356.119420:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390356.119429:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10069:x1875263097979008:12345-0@lo:5: 00002000:00080000:3.0:1788390356.122273:0:8407:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788390356.122291:0:8407:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1788390356.123216:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:0.0:1788390356.123265:0:10065:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788390356.123291:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875263097979264:0@lo:7: 00000100:00100000:0.0:1788390356.123383:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390356.123405:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390356.123497:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097979264 00000100:00100000:2.0:1788390356.123505:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097979264 00000100:00100000:2.0:1788390356.123547:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390356.123556:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10065:x1875263097979264:12345-0@lo:7: 00000100:00100000:1.0:1788390356.126679:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097979136:0@lo:13: 00000100:00100000:1.0:1788390356.126756:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390356.127176:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10069:x1875263097979008:12345-0@lo:5: Request processed in 7746us (7943us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788390356.127188:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00080000:1.0:1788390356.129270:0:8798:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788390356.129279:0:8798:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788390356.129509:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10065:x1875263097979264:12345-0@lo:7: Request processed in 5948us (6121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.129519:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788390356.129580:0:10069:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb28e300 x1875263097979008/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390372 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390356.129597:0:10069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10069:1875263097979008:0@lo:5: 00000004:00080000:1.0:1788390356.129610:0:10069:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00080000:2.0:1788390356.129694:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877cb800 x1875263097979264/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788390372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.129704:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875263097979264:0@lo:7: 00000004:00080000:2.0:1788390356.129713:0:10065:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788390356.129749:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875263097979392:0@lo:5: 00000100:00100000:2.0:1788390356.129785:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390356.129815:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390356.129880:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097979392 00000100:00100000:1.0:1788390356.129893:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097979392 00000100:00100000:1.0:1788390356.129977:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390356.129986:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10065:x1875263097979392:12345-0@lo:5: 00002000:00080000:1.0:1788390356.130012:0:8409:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788390356.130052:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10065:x1875263097979392:12345-0@lo:5: Request processed in 67us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390356.130059:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788390356.130114:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741b100 x1875263097979392/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390356.130123:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875263097979392:0@lo:5: 00000004:00080000:2.0:1788390356.130132:0:10065:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788390356.130230:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097979136 00000100:00100000:0.0:1788390356.130235:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097979136 00000100:00100000:0.0:1788390356.130265:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390356.130273:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097979136:12345-0@lo:13: 00002000:00000024:0.0:1788390356.130289:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788390356.130343:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097979136:12345-0@lo:13: Request processed in 71us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390356.130350:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788390356.130684:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877c9c00 x1875263097979136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390356.130700:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097979136:0@lo:13: 00010000:00010000:2.0:1788390357.137749:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390357.268754:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390357.268833:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088492928 00000100:00100000:3.0:1788390357.268848:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088492928 00000100:00100000:3.0:1788390357.268949:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 180 00000100:00100000:3.0:1788390357.268958:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1875263088492928:12345-192.168.202.11@tcp:250: 00010000:00080000:3.0:1788390357.268989:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5ec441e1-c819-43bb-9906-f4af85d85a23@192.168.202.11@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1788390357.269026:0:6486:0:(genops.c:1385:class_connect()) connect: client 5ec441e1-c819-43bb-9906-f4af85d85a23, cookie 0xe156d0713be97589 00000100:00080000:3.0:1788390357.269194:0:6486:0:(import.c:65:import_set_state_nolock()) ffff984fc19e5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390357.269276:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+5:2403:x1875263088492928:12345-192.168.202.11@tcp:250: Request processed in 316us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390357.269283:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 180 00000100:00100000:2.0:1788390357.271592:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390357.271813:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088492800 00000100:00100000:1.0:1788390357.271824:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088492800 00000100:00100000:1.0:1788390357.271892:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 181 00000100:00100000:1.0:1788390357.271903:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+5:6154:x1875263088492800:12345-192.168.202.11@tcp:101: 00010000:00010000:1.0:1788390357.271919:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390357.271936:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243c0a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390357.271965:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c0a expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390357.271976:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c0a expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390357.271986:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5a00, rc 0) 00000100:00100000:1.0:1788390357.272053:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+6:6154:x1875263088492800:12345-192.168.202.11@tcp:101: Request processed in 151us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390357.272061:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 181 00000100:00100000:0.0:1788390357.280068:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390357.280282:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088493056 00000100:00100000:2.0:1788390357.280560:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088493056 00000100:00100000:2.0:1788390357.280677:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 182 00000100:00100000:2.0:1788390357.280689:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+6:6154:x1875263088493056:12345-192.168.202.11@tcp:501: 00000100:00100000:2.0:1788390357.280833:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+6:6154:x1875263088493056:12345-192.168.202.11@tcp:501: Request processed in 145us (778us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390357.280841:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 182 00000100:00100000:0.0:1788390357.292089:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390357.292282:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088493184 00000100:00100000:1.0:1788390357.292489:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088493184 00000100:00100000:1.0:1788390357.292723:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 183 00000100:00100000:1.0:1788390357.292735:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+6:6154:x1875263088493184:12345-192.168.202.11@tcp:101: 00010000:00010000:1.0:1788390357.292756:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390357.292774:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243c11 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390357.292805:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c11 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390357.292816:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c11 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390357.292827:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4400, rc 0) 00000100:00100000:1.0:1788390357.292909:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+7:6154:x1875263088493184:12345-192.168.202.11@tcp:101: Request processed in 176us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390357.292916:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 183 00000100:00100000:0.0:1788390357.303736:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390357.303841:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088493312 00000100:00100000:1.0:1788390357.303872:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088493312 00000100:00100000:1.0:1788390357.303933:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 184 00000100:00100000:1.0:1788390357.303944:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+7:6154:x1875263088493312:12345-192.168.202.11@tcp:501: 00000100:00100000:1.0:1788390357.304184:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+8:6154:x1875263088493312:12345-192.168.202.11@tcp:501: Request processed in 241us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390357.304192:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 184 00000100:00100000:0.0:1788390357.314562:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390357.314956:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088493440 00000100:00100000:1.0:1788390357.314969:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088493440 00000100:00100000:1.0:1788390357.315036:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 185 00000100:00100000:1.0:1788390357.315061:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+8:6154:x1875263088493440:12345-192.168.202.11@tcp:503: 00000100:00100000:1.0:1788390357.315254:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+8:6154:x1875263088493440:12345-192.168.202.11@tcp:503: Request processed in 195us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390357.315262:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 185 00000100:00100000:0.0:1788390357.326175:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390357.326302:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088493568 00000100:00100000:1.0:1788390357.326508:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088493568 00000100:00100000:1.0:1788390357.326661:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 186 00000100:00100000:1.0:1788390357.326692:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+8:6173:x1875263088493568:12345-192.168.202.11@tcp:502: 00000100:00100000:1.0:1788390357.326864:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+8:6173:x1875263088493568:12345-192.168.202.11@tcp:502: Request processed in 177us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390357.326873:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 186 00000100:00100000:0.0:1788390357.358932:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390357.359096:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088493696 00000100:00100000:3.0:1788390357.359108:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088493696 00000100:00100000:3.0:1788390357.359192:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 187 00000100:00100000:3.0:1788390357.359205:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+8:6173:x1875263088493696:12345-192.168.202.11@tcp:502: 00000100:00100000:3.0:1788390357.360984:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+8:6173:x1875263088493696:12345-192.168.202.11@tcp:502: Request processed in 1770us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390357.360997:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 187 00000100:00100000:0.0:1788390357.374693:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390357.375277:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088493824 00000100:00100000:1.0:1788390357.375291:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088493824 00000100:00100000:1.0:1788390357.375549:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 188 00000100:00100000:1.0:1788390357.375561:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+8:6154:x1875263088493824:12345-192.168.202.11@tcp:101: 00010000:00010000:1.0:1788390357.375579:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390357.375597:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4200/0xe156d0713be9759e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243c42 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390357.375627:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4200/0xe156d0713be9759e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c42 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390357.375638:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4200/0xe156d0713be9759e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c42 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390357.375648:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4200, rc 0) 00000100:00100000:1.0:1788390357.375748:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6154:x1875263088493824:12345-192.168.202.11@tcp:101: Request processed in 189us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390357.375771:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 188 00000100:00100000:0.0:1788390357.385291:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390357.385674:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088493952 00000100:00100000:3.0:1788390357.385687:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088493952 00000100:00100000:3.0:1788390357.385749:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 189 00000100:00100000:3.0:1788390357.385760:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6154:x1875263088493952:12345-192.168.202.11@tcp:256: 20000000:01000000:3.0:1788390357.385782:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788390357.385803:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788390357.385806:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788390357.385808:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788390357.385810:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788390357.385812:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788390357.392956:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6154:x1875263088493952:12345-192.168.202.11@tcp:256: Request processed in 7182us (7662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390357.392975:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 189 00000100:00100000:0.0:1788390357.402760:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390357.404014:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088494080 00000100:00100000:2.0:1788390357.404026:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088494080 00000100:00100000:2.0:1788390357.404096:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 190 00000100:00100000:2.0:1788390357.404107:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6154:x1875263088494080:12345-192.168.202.11@tcp:101: 00010000:00010000:2.0:1788390357.404146:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390357.404164:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243c49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390357.404194:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c49 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390357.404206:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c49 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390357.404215:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:2.0:1788390357.404656:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6154:x1875263088494080:12345-192.168.202.11@tcp:101: Request processed in 179us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390357.404666:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 190 00000100:00100000:0.0:1788390357.408011:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390357.408088:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088494208 00000100:00100000:3.0:1788390357.408098:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088494208 00000100:00100000:3.0:1788390357.408153:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 191 00000100:00100000:3.0:1788390357.408162:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6154:x1875263088494208:12345-192.168.202.11@tcp:501: 00000100:00100000:3.0:1788390357.408317:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6154:x1875263088494208:12345-192.168.202.11@tcp:501: Request processed in 156us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390357.408358:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 191 00000100:00100000:0.0:1788390357.429276:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390357.429393:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088494336 00000100:00100000:3.0:1788390357.429404:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088494336 00000100:00100000:3.0:1788390357.429468:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 192 00000100:00100000:3.0:1788390357.429478:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6154:x1875263088494336:12345-192.168.202.11@tcp:503: 00000100:00100000:3.0:1788390357.429650:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6154:x1875263088494336:12345-192.168.202.11@tcp:503: Request processed in 172us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390357.429658:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 192 00000100:00100000:0.0:1788390357.433904:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390357.434105:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088494464 00000100:00100000:2.0:1788390357.434115:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088494464 00000100:00100000:2.0:1788390357.434179:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 193 00000100:00100000:2.0:1788390357.434190:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6178:x1875263088494464:12345-192.168.202.11@tcp:502: 00000100:00100000:2.0:1788390357.434391:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6178:x1875263088494464:12345-192.168.202.11@tcp:502: Request processed in 202us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390357.434400:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 193 00000100:00100000:0.0:1788390357.437676:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390357.439020:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088494592 00000100:00100000:2.0:1788390357.439037:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088494592 00000100:00100000:2.0:1788390357.439113:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 194 00000100:00100000:2.0:1788390357.439129:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6178:x1875263088494592:12345-192.168.202.11@tcp:502: 00000100:00100000:2.0:1788390357.439308:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6178:x1875263088494592:12345-192.168.202.11@tcp:502: Request processed in 185us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390357.439358:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 194 00000100:00100000:0.0:1788390357.451608:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390357.451655:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390357.451911:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088494720 00000100:00100000:2.0:1788390357.451923:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088494720 00000100:00100000:2.0:1788390357.451973:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088494976 00000100:00100000:2.0:1788390357.451977:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088494976 00000100:00100000:2.0:1788390357.451998:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:2.0:1788390357.452006:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875263088494720:12345-192.168.202.11@tcp:38: 00010000:00080000:2.0:1788390357.452039:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1788390357.452097:0:6492:0:(genops.c:1385:class_connect()) connect: client 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa, cookie 0xe156d0713be975ac 00000004:00100000:2.0:1788390357.452120:0:6492:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788390357.452352:0:6492:0:(import.c:65:import_set_state_nolock()) ffff984e85f72000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390357.452425:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2403:x1875263088494720:12345-192.168.202.11@tcp:38: Request processed in 418us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390357.452432:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:2.0:1788390357.452451:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:2.0:1788390357.452456:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875263088494976:12345-192.168.202.11@tcp:38: 00010000:00080000:2.0:1788390357.452471:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1788390357.452523:0:6492:0:(genops.c:1385:class_connect()) connect: client 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa, cookie 0xe156d0713be975b3 00000004:00100000:2.0:1788390357.452537:0:6492:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788390357.452686:0:6492:0:(import.c:65:import_set_state_nolock()) ffff984e876b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390357.452712:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2403:x1875263088494976:12345-192.168.202.11@tcp:38: Request processed in 255us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390357.452718:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 8 00010000:00010000:1.0:1788390358.164023:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390358.463896:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390358.463938:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390358.463974:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390358.466399:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088495232 00000100:00100000:0.0:1788390358.466415:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088495232 00000100:00100000:0.0:1788390358.466492:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088495104 00000100:00100000:0.0:1788390358.466496:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088495104 00000100:00100000:0.0:1788390358.466520:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088494848 00000100:00100000:0.0:1788390358.466523:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088494848 00000100:00100000:0.0:1788390358.466544:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:0.0:1788390358.466555:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:6154:x1875263088495232:12345-192.168.202.11@tcp:41: 00000004:00000024:0.0:1788390358.466593:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788390358.466663:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:6154:x1875263088495232:12345-192.168.202.11@tcp:41: Request processed in 109us (2778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390358.466671:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:0.0:1788390358.466691:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:0.0:1788390358.466698:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:0:x1875263088495104:12345-192.168.202.11@tcp:41: 00000004:00000024:0.0:1788390358.466713:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788390358.466737:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:0:x1875263088495104:12345-192.168.202.11@tcp:41: Request processed in 40us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390358.466743:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:0.0:1788390358.466758:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:0.0:1788390358.466765:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:0:x1875263088494848:12345-192.168.202.11@tcp:41: 00000004:00000024:0.0:1788390358.466775:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788390358.466795:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:0:x1875263088494848:12345-192.168.202.11@tcp:41: Request processed in 31us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390358.466801:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00080000:1.0:1788390358.467227:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390358.467232:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390358.471269:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390358.476671:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088495360 00000100:00100000:1.0:1788390358.476690:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088495360 00000100:00100000:1.0:1788390358.476912:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:1.0:1788390358.476923:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6154:x1875263088495360:12345-192.168.202.11@tcp:40: 00000100:00100000:1.0:1788390358.477022:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6154:x1875263088495360:12345-192.168.202.11@tcp:40: Request processed in 101us (5917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390358.477029:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:0.0:1788390358.483462:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390358.483515:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390358.483577:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088495488 00000100:00100000:0.0:1788390358.483587:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088495488 00000100:00100000:0.0:1788390358.483623:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088495616 00000100:00100000:0.0:1788390358.483626:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088495616 00000100:00100000:0.0:1788390358.483645:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:0.0:1788390358.483653:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875263088495488:12345-192.168.202.11@tcp:8: 00010000:00080000:0.0:1788390358.483685:0:8798:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788390358.483717:0:8798:0:(genops.c:1385:class_connect()) connect: client 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa, cookie 0xe156d0713be975ba 00002000:00100000:0.0:1788390358.483730:0:8798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa/ffff984fc19af000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390358.483749:0:8798:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390358.483968:0:8798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788390358.484001:0:8798:0:(import.c:65:import_set_state_nolock()) ffff984fc19aa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390358.484075:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2403:x1875263088495488:12345-192.168.202.11@tcp:8: Request processed in 421us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390358.484083:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:0.0:1788390358.484105:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:0.0:1788390358.484109:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875263088495616:12345-192.168.202.11@tcp:8: 00010000:00080000:0.0:1788390358.484125:0:8798:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788390358.484139:0:8798:0:(genops.c:1385:class_connect()) connect: client 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa, cookie 0xe156d0713be975c1 00002000:00100000:0.0:1788390358.484144:0:8798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa/ffff984fc19aa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390358.484154:0:8798:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390358.484268:0:8798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788390358.484288:0:8798:0:(import.c:65:import_set_state_nolock()) ffff984fc19ab000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390358.484311:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2403:x1875263088495616:12345-192.168.202.11@tcp:8: Request processed in 200us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390358.484317:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:0.0:1788390358.490369:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390358.490559:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088495744 00000100:00100000:2.0:1788390358.490569:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088495744 00000100:00100000:2.0:1788390358.490640:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:2.0:1788390358.490649:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6154:x1875263088495744:12345-192.168.202.11@tcp:900: 00000100:00100000:2.0:1788390358.490739:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6154:x1875263088495744:12345-192.168.202.11@tcp:900: Request processed in 90us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390358.490746:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:0.0:1788390358.493260:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390358.493487:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088495872 00000100:00100000:2.0:1788390358.493500:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088495872 00000100:00100000:2.0:1788390358.493571:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:2.0:1788390358.493585:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6154:x1875263088495872:12345-192.168.202.11@tcp:33: 00000100:00100000:0.0:1788390358.496826:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390358.497495:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088496000 00000100:00100000:1.0:1788390358.497509:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088496000 00000100:00100000:1.0:1788390358.497579:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 195 00000100:00100000:1.0:1788390358.497591:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2405:x1875263088496000:12345-192.168.202.11@tcp:400: 00000100:00100000:1.0:1788390358.497679:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2405:x1875263088496000:12345-192.168.202.11@tcp:400: Request processed in 89us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390358.497687:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 195 00000004:00080000:3.0:1788390358.523919:0:6495:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30207us 00000004:00200000:0.0:1788390358.543445:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788390358.543761:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6154:x1875263088495872:12345-192.168.202.11@tcp:33: Request processed in 50163us (50501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390358.543786:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:2.0:1788390358.609985:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390358.610028:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097979520:0@lo:41: 00000100:00100000:2.0:1788390358.610124:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390358.610480:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097979520 00000100:00100000:0.0:1788390358.610492:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097979520 00000100:00100000:0.0:1788390358.610558:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788390358.610571:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097979520:12345-0@lo:41: 00000004:00000024:0.0:1788390358.610609:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788390358.610683:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097979520:12345-0@lo:41: Request processed in 114us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390358.610691:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788390358.610800:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097979520:0@lo:41: 00000100:00100000:0.0:1788390358.790058:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390358.790223:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088496128 00000100:00100000:3.0:1788390358.790237:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088496128 00000100:00100000:3.0:1788390358.790362:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:3.0:1788390358.790532:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6197:x1875263088496128:12345-192.168.202.11@tcp:101: 00010000:00010000:3.0:1788390358.790561:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390358.790715:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734c00/0xe156d0713be975c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243c7a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390358.790789:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be975cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390358.790803:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be975cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390358.790818:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be975cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390358.790886:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788390358.790889:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390358.790903:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be975cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390358.790927:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734c00/0xe156d0713be975c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c7a expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390358.790950:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be975cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c7a expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390358.790974:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7866500) 00010000:00010000:3.0:1788390358.790988:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390358.790992:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735000, rc 0) 00000100:00100000:3.0:1788390358.791072:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:6197:x1875263088496128:12345-192.168.202.11@tcp:101: Request processed in 700us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390358.791078:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 13 00010000:00010000:2.0:1788390359.185590:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390360.209887:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390360.636477:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390360.636630:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088496256 00000100:00100000:2.0:1788390360.636642:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088496256 00000100:00080000:1.0:1788390360.636729:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390360.636799:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 14 00000100:00100000:2.0:1788390360.636813:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:6249:x1875263088496256:12345-192.168.202.11@tcp:41: 00000004:00000024:2.0:1788390360.636883:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788390360.636997:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:6249:x1875263088496256:12345-192.168.202.11@tcp:41: Request processed in 186us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390360.637008:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 14 00000100:00100000:0.0:1788390360.639931:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390360.640033:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088496384 00000100:00100000:3.0:1788390360.640048:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088496384 00000100:00080000:1.0:1788390360.640139:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390360.640164:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:3.0:1788390360.640181:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6249:x1875263088496384:12345-192.168.202.11@tcp:41: 00000004:00000024:3.0:1788390360.640233:0:8996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788390360.640570:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6249:x1875263088496384:12345-192.168.202.11@tcp:41: Request processed in 393us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390360.640579:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:1.0:1788390360.648007:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390360.648482:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088496512 00000100:00100000:0.0:1788390360.648494:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088496512 00000100:00100000:0.0:1788390360.648591:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:0.0:1788390360.648604:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6249:x1875263088496512:12345-192.168.202.11@tcp:13: 00002000:00000024:0.0:1788390360.648648:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788390360.649031:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390360.650131:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6249:x1875263088496512:12345-192.168.202.11@tcp:13: Request processed in 1520us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390360.650143:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:0.0:1788390360.651968:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390360.652073:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088496640 00000100:00100000:2.0:1788390360.652098:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088496640 00000100:00100000:2.0:1788390360.652426:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:2.0:1788390360.652436:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6249:x1875263088496640:12345-192.168.202.11@tcp:13: 00002000:00000024:2.0:1788390360.652472:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390360.652580:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:6249:x1875263088496640:12345-192.168.202.11@tcp:13: Request processed in 146us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390360.652586:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00080000:1.0:1788390360.653564:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390360.657553:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097979648:0@lo:41: 00000100:00100000:3.0:1788390360.657689:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097979776:0@lo:13: 00000100:00100000:2.0:1788390360.657699:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390360.657710:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097979904:0@lo:13: 00000100:00100000:3.0:1788390360.657752:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390360.657793:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097979776 00000100:00100000:3.0:1788390360.657855:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097979648 00000100:00100000:3.0:1788390360.657860:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097979648 00000100:00100000:1.0:1788390360.657876:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097979776 00000100:00100000:3.0:1788390360.657924:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788390360.657932:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390360.657938:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097979648:12345-0@lo:41: 00000100:00100000:1.0:1788390360.657945:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097979776:12345-0@lo:13: 00000100:00100000:0.0:1788390360.657954:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788390360.657971:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1788390360.657977:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:0.0:1788390360.658002:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390360.658027:0:8410:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788390360.658040:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097979776:12345-0@lo:13: Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390360.658045:0:8410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788390360.658051:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390360.658070:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097979904 00000100:00100000:1.0:1788390360.658073:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097979904 00000100:00100000:1.0:1788390360.658099:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390360.658105:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097979904:12345-0@lo:13: 00002000:00000024:1.0:1788390360.658116:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390360.658145:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097979904:12345-0@lo:13: Request processed in 40us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390360.658151:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788390360.658167:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788390360.658198:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984f85ae0a80 x1875263097979904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390360.658233:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097979904:0@lo:13: 00010000:00080000:1.0:1788390360.658354:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984f85ae2680 x1875263097979776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390360.658370:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097979776:0@lo:13: 00000100:00100000:3.0:1788390360.658483:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097979648:12345-0@lo:41: Request processed in 548us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390360.658491:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788390360.658551:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097979648:0@lo:41: 00000100:00100000:1.0:1788390361.169549:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097980032:0@lo:13: 00000100:00100000:1.0:1788390361.169660:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390361.169766:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097980032 00000100:00100000:1.0:1788390361.169775:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097980032 00000100:00100000:1.0:1788390361.169877:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390361.169894:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263097980032:12345-0@lo:13: 00002000:00000024:1.0:1788390361.169928:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390361.169990:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263097980032:12345-0@lo:13: Request processed in 102us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390361.170006:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390361.170019:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875263097980288:0@lo:5: 00000100:00080000:1.0:1788390361.170033:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390361.170065:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788390361.170093:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984f85ae2680 x1875263097980032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390361.170109:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390361.170118:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097980032:0@lo:13: 00000100:00100000:2.0:1788390361.170129:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097980160:0@lo:13: 00000100:00100000:2.0:1788390361.170157:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390361.170212:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097980288 00000100:00100000:2.0:1788390361.170217:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097980288 00000100:00080000:3.0:1788390361.170273:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390361.170307:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097980160 00000100:00100000:1.0:1788390361.170312:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097980160 00000100:00100000:2.0:1788390361.170493:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390361.170515:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10065:x1875263097980288:12345-0@lo:5: 00002000:00080000:2.0:1788390361.170557:0:8798:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1788390361.171399:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390361.171408:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875263097980160:12345-0@lo:13: 00002000:00000024:1.0:1788390361.171422:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390361.171476:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875263097980160:12345-0@lo:13: Request processed in 69us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390361.171483:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788390361.171552:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8794b480 x1875263097980160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390361.171571:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097980160:0@lo:13: 00000100:00100000:1.0:1788390361.173399:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097980544:0@lo:400: 00000100:00100000:0.0:1788390361.173400:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097980416:0@lo:400: 00000100:00100000:0.0:1788390361.174442:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390361.174456:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390361.174494:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263097980928:0@lo:400: 00000100:00100000:1.0:1788390361.174516:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263097981056:0@lo:400: 00000100:00100000:0.0:1788390361.174539:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390361.174619:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097980416 00000100:00100000:0.0:1788390361.174631:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097980416 00000100:00100000:0.0:1788390361.174705:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788390361.174717:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263097980416:12345-0@lo:400: 00000100:00100000:0.0:1788390361.174793:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263097980416:12345-0@lo:400: Request processed in 77us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390361.174803:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788390361.174879:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097980544 00000100:00100000:0.0:1788390361.174884:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097980544 00000100:00100000:0.0:1788390361.174933:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097980928 00000100:00100000:0.0:1788390361.174937:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097980928 00000100:00100000:0.0:1788390361.174984:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788390361.174994:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097980544:12345-0@lo:400: 00000100:00100000:0.0:1788390361.175040:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263097980544:12345-0@lo:400: Request processed in 49us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390361.175048:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788390361.175072:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390361.175080:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263097980928:12345-0@lo:400: 00000100:00100000:0.0:1788390361.175297:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263097980928:12345-0@lo:400: Request processed in 216us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390361.175315:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788390361.175392:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390361.175415:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390361.175468:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263097980544:0@lo:400: 00000100:00100000:0.0:1788390361.175498:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097981056 00000100:00100000:0.0:1788390361.175503:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097981056 00000100:00100000:0.0:1788390361.175540:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788390361.175551:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263097981056:12345-0@lo:400: 00000100:00100000:0.0:1788390361.175597:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263097981056:12345-0@lo:400: Request processed in 47us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390361.175607:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788390361.175627:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788390361.175662:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb16dc00 x1875263097981056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390361.175677:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263097981056:0@lo:400: 00000100:00100000:0.0:1788390361.175707:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097980416:0@lo:400: 00000100:00100000:0.0:1788390361.175724:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263097980928:0@lo:400: 00000100:00100000:2.0:1788390361.176282:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10065:x1875263097980288:12345-0@lo:5: Request processed in 5780us (6215us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788390361.176293:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788390361.176317:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8794ad80 x1875263097980288/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390377 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390361.176350:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875263097980288:0@lo:5: 00000004:00080000:0.0:1788390361.176369:0:10065:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788390361.176413:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10065:1875263097981440:0@lo:900: 00000100:00100000:0.0:1788390361.176451:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390361.176473:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788390361.176504:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097981440 00000100:00100000:0.0:1788390361.176509:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097981440 00000100:00100000:0.0:1788390361.176548:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390361.176556:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10065:x1875263097981440:12345-0@lo:900: 00000100:00100000:0.0:1788390361.176595:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10065:x1875263097981440:12345-0@lo:900: Request processed in 41us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390361.176600:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390361.176628:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10065:1875263097981440:0@lo:900: 00000100:00100000:1.0:1788390361.176941:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263097980800:0@lo:400: 00000100:00100000:1.0:1788390361.176979:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390361.177007:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263097981312:0@lo:400: 00000100:00100000:1.0:1788390361.177034:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390361.177054:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788390361.177061:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097980672:0@lo:400: 00000100:00100000:1.0:1788390361.177084:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390361.177102:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263097981184:0@lo:400: 00000100:00100000:1.0:1788390361.177131:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390361.177165:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097980672 00000100:00100000:1.0:1788390361.177169:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097980672 00000100:00100000:1.0:1788390361.177204:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390361.177213:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097980672:12345-0@lo:400: 00000100:00100000:1.0:1788390361.177259:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263097980672:12345-0@lo:400: Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390361.177276:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390361.177301:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097980800 00000100:00100000:1.0:1788390361.177306:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097980800 00000100:00100000:1.0:1788390361.177359:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097981312 00000100:00100000:1.0:1788390361.177362:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097981312 00000100:00100000:1.0:1788390361.177385:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097981184 00000100:00100000:1.0:1788390361.177388:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097981184 00000100:00100000:1.0:1788390361.177415:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788390361.177421:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263097980800:12345-0@lo:400: 00000100:00100000:1.0:1788390361.177462:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263097980800:12345-0@lo:400: Request processed in 41us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390361.177477:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788390361.177493:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788390361.177500:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875263097981312:12345-0@lo:400: 00000100:00100000:1.0:1788390361.177530:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875263097981312:12345-0@lo:400: Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390361.177536:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788390361.177559:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390361.177565:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263097981184:12345-0@lo:400: 00000100:00100000:1.0:1788390361.177708:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263097981184:12345-0@lo:400: Request processed in 143us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390361.177714:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788390361.177783:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390361.177787:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390361.177881:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263097980672:0@lo:400: 00000100:00100000:1.0:1788390361.177894:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263097981184:0@lo:400: 00000100:00100000:1.0:1788390361.177904:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263097980800:0@lo:400: 00010000:00080000:1.0:1788390361.177931:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb16df80 x1875263097981312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390361.177989:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263097981312:0@lo:400: 00000001:00100000:1.0:1788390361.178831:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000001:00080000:1.0:1788390361.178849:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788390361.234489:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390362.257545:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788390362.571724:0:10156:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788390363.219752:0:7423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000001:00100000:2.0:1788390363.220350:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00010000:00010000:2.0:1788390363.286817:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390363.731217:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390363.731243:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097981568:0@lo:41: 00000100:00100000:0.0:1788390363.731306:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390363.732014:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097981568 00000100:00100000:3.0:1788390363.732024:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097981568 00000100:00100000:3.0:1788390363.732096:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788390363.732107:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097981568:12345-0@lo:41: 00000004:00000024:3.0:1788390363.732146:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788390363.732233:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097981568:12345-0@lo:41: Request processed in 128us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390363.732240:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390363.732294:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097981568:0@lo:41: 00000100:00100000:0.0:1788390363.929004:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390363.929040:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390363.929074:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390363.929101:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390363.929127:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390363.929160:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088496896 00000100:00100000:0.0:1788390363.929169:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088496896 00000100:00100000:0.0:1788390363.929229:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088497024 00000100:00100000:0.0:1788390363.929233:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088497024 00000100:00100000:0.0:1788390363.929259:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:0.0:1788390363.929270:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088496896:12345-192.168.202.11@tcp:400: 00000100:00100000:0.0:1788390363.929370:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088496896:12345-192.168.202.11@tcp:400: Request processed in 101us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390363.929378:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:0.0:1788390363.929402:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:0.0:1788390363.929410:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088497024:12345-192.168.202.11@tcp:400: 00000100:00100000:0.0:1788390363.929452:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088497024:12345-192.168.202.11@tcp:400: Request processed in 42us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390363.929458:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:0.0:1788390363.929480:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088497280 00000100:00100000:0.0:1788390363.929484:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088497280 00000100:00100000:0.0:1788390363.929511:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088497152 00000100:00100000:0.0:1788390363.929514:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088497152 00000100:00100000:0.0:1788390363.929534:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:0.0:1788390363.929542:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088497280:12345-192.168.202.11@tcp:400: 00000100:00100000:0.0:1788390363.929573:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088497280:12345-192.168.202.11@tcp:400: Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390363.929580:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:2.0:1788390363.929602:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088496768 00000100:00100000:0.0:1788390363.929602:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:0.0:1788390363.929616:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088497152:12345-192.168.202.11@tcp:400: 00000100:00100000:2.0:1788390363.929617:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088496768 00000100:00100000:0.0:1788390363.929667:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088497152:12345-192.168.202.11@tcp:400: Request processed in 51us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390363.929675:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:2.0:1788390363.929703:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 197 00000100:00080000:0.0:1788390363.929707:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390363.929715:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390363.929721:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2404:x1875263088496768:12345-192.168.202.11@tcp:400: 00000100:00080000:0.0:1788390363.929722:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788390363.929725:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390363.929879:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2404:x1875263088496768:12345-192.168.202.11@tcp:400: Request processed in 166us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390363.929885:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 197 00000001:00100000:0.0:1788390364.244822:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00010000:00010000:1.0:1788390364.305724:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390365.329517:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390365.547732:0:10304:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea27e40a0 20000000:00000080:3.0:1788390365.547758:0:10304:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984e879be400 uarg=0000000000000000 20000000:01000000:3.0:1788390365.548429:0:10304:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788390365.548432:0:10304:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788390365.548436:0:10304:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788390365.548442:0:10304:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788390365.548448:0:10304:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788390365.548540:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788390365.548543:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788390365.550946:0:10305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788390365.554734:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788390365.554779:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788390365.554811:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788390365.554824:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788390365.554827:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788390365.557805:0:10306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788390365.564116:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788390365.564173:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788390365.564190:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1788390365.564202:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788390365.564205:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788390365.567568:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788390365.567913:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788390365.567946:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788390365.567960:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788390365.567974:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788390365.567978:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788390365.568383:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788390365.568555:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788390365.568572:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788390365.568585:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788390365.568594:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788390365.568596:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788390365.568865:0:10309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788390365.569148:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788390365.569170:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788390365.569184:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:1.0:1788390365.569197:0:10304:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788390365.569221:0:10304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569242:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9746a expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569251:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97494 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569259:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be974d3 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569277:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be974e1 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569285:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be974ef expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569292:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9750b expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569299:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97535 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569306:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97551 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569313:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9757b expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569360:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c0a expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569368:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c11 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569377:0:10304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569426:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c11 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569454:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c11 expref: 9 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.569471:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097981696:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390365.569599:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c0a expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569608:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c0a expref: 9 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.569617:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097981824:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390365.569643:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9757b expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569651:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9757b expref: 23 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.569661:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097981952:0@lo:104: 00000100:00100000:1.0:1788390365.569702:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390365.569739:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97551 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569747:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97551 expref: 23 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.569756:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982080:0@lo:104: 00000100:00100000:1.0:1788390365.569774:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390365.569846:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097981952 00010000:00010000:1.0:1788390365.569847:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97535 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.569858:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097981952 00010000:00010000:1.0:1788390365.569859:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97535 expref: 23 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.569871:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982208:0@lo:104: 00000100:00100000:1.0:1788390365.569897:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390365.569909:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097982080 00000100:00100000:3.0:1788390365.569914:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097982080 00010000:00010000:1.0:1788390365.569914:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9750b expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569925:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9750b expref: 23 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.569928:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097982208 00000100:00100000:3.0:1788390365.569932:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097982208 00000100:00100000:1.0:1788390365.569940:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982336:0@lo:104: 00000100:00100000:3.0:1788390365.569950:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390365.569964:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+5:10304:x1875263097981952:12345-0@lo:104: 00000100:00100000:1.0:1788390365.569966:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390365.569983:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.569985:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be974ef expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.570004:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be974ef expref: 23 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.570012:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982464:0@lo:104: 00010000:00010000:1.0:1788390365.570045:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be974e1 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.570053:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be974e1 expref: 23 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.570061:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982592:0@lo:104: 00010000:00010000:3.0:1788390365.570075:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390365.570090:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+5:10304:x1875263097981952:12345-0@lo:104: Request processed in 129us (387us total) trans 0 rc 0/0 00010000:00010000:1.0:1788390365.570095:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be974d3 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.570106:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be974d3 expref: 23 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.570112:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788390365.570119:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982720:0@lo:104: 00010000:00010000:1.0:1788390365.570140:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97494 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.570145:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1788390365.570148:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97494 expref: 23 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.570157:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982848:0@lo:104: 00000100:00100000:3.0:1788390365.570172:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390365.570187:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390365.570198:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390365.570207:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.570215:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9746a expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.570220:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390365.570227:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.570229:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9746a expref: 23 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.570250:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.570250:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982976:0@lo:104: 10000000:00010000:3.0:1788390365.570264:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390365.570272:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788390365.570275:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390365.570286:0:10304:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90f66300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390365.570309:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097981952:0@lo:104: 00010000:00010000:3.0:1788390365.570318:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.570353:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390365.570383:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.570391:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be9757b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97582 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.570407:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390365.570415:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390365.570417:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097982336 00010000:00010000:3.0:1788390365.570418:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390365.570424:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097982336 00000100:00100000:3.0:1788390365.570442:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390365.570446:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097982464 00000100:00100000:2.0:1788390365.570450:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097982464 00000100:00100000:3.0:1788390365.570457:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097983104:0@lo:103: 00000100:00100000:2.0:1788390365.570460:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097982848 00000100:00100000:2.0:1788390365.570465:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097982848 00000100:00100000:2.0:1788390365.570476:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097982976 00000100:00100000:2.0:1788390365.570478:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097982976 00000100:00100000:2.0:1788390365.570492:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390365.570500:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+8:10304:x1875263097982080:12345-0@lo:104: 00000100:00100000:3.0:1788390365.570505:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390365.570513:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.570548:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390365.570563:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390365.570573:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390365.570573:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+8:10304:x1875263097982080:12345-0@lo:104: Request processed in 71us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.570582:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390365.570583:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788390365.570592:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788390365.570595:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097982592 00000100:00100000:2.0:1788390365.570605:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097982592 00000100:00100000:2.0:1788390365.570618:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097982720 00000100:00100000:2.0:1788390365.570620:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097982720 00000100:00100000:2.0:1788390365.570630:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390365.570635:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+9:10304:x1875263097982208:12345-0@lo:104: 00010000:00010000:2.0:1788390365.570642:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.570680:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788390365.570685:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+9:10304:x1875263097982208:12345-0@lo:104: Request processed in 50us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.570691:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390365.570702:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788390365.570707:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f98dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+8:10304:x1875263097982336:12345-0@lo:104: 00010000:00010000:2.0:1788390365.570713:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.570738:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788390365.570742:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f98dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+8:10304:x1875263097982336:12345-0@lo:104: Request processed in 36us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.570748:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788390365.570781:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390365.570799:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+7:10304:x1875263097982464:12345-0@lo:104: 00010000:00010000:2.0:1788390365.570806:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.570829:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788390365.570833:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+7:10304:x1875263097982464:12345-0@lo:104: Request processed in 36us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.570844:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390365.570854:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788390365.570860:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+6:10304:x1875263097982848:12345-0@lo:104: 00010000:00010000:2.0:1788390365.570867:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.570889:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788390365.570893:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+6:10304:x1875263097982848:12345-0@lo:104: Request processed in 34us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.570898:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788390365.570907:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788390365.570912:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+5:10304:x1875263097982976:12345-0@lo:104: 00010000:00010000:2.0:1788390365.570918:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.570937:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788390365.570941:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+5:10304:x1875263097982976:12345-0@lo:104: Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.570947:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788390365.570955:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788390365.570960:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+4:10304:x1875263097982592:12345-0@lo:104: 00010000:00010000:2.0:1788390365.570966:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.570985:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788390365.570989:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+4:10304:x1875263097982592:12345-0@lo:104: Request processed in 30us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.571000:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788390365.571009:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788390365.571015:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:10304:x1875263097982720:12345-0@lo:104: 00010000:00010000:2.0:1788390365.571022:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571043:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788390365.571048:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:10304:x1875263097982720:12345-0@lo:104: Request processed in 34us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.571053:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788390365.571088:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788390365.571093:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571101:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734400 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390365.571104:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571112:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390365.571120:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390365.571125:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390365.571146:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571152:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390365.571175:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571183:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf734400/0xe156d0713be97551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97558 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571204:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788390365.571207:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571212:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390365.571215:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571229:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390365.571236:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390365.571242:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390365.571254:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571260:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390365.571264:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571271:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce200/0xe156d0713be97535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9753c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571280:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788390365.571287:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571294:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390365.571297:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571304:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390365.571309:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390365.571315:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390365.571366:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571373:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390365.571380:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571388:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be9750b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97512 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571396:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788390365.571399:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571405:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390365.571408:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571424:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390365.571431:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390365.571437:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390365.571448:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571454:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390365.571458:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571465:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be974ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be974f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571474:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788390365.571477:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571483:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80031c00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390365.571486:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571493:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390365.571500:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390365.571509:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390365.571521:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571527:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390365.571531:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571537:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9749b expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571547:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788390365.571550:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571556:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5e00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390365.571559:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571565:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390365.571570:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390365.571576:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390365.571586:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571592:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390365.571600:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571607:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be9746a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97471 expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571617:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390365.571620:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571626:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390365.571629:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571637:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390365.571642:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390365.571648:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390365.571658:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571665:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390365.571668:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571674:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4600/0xe156d0713be974e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be974e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571683:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390365.571690:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571696:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80030c00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390365.571699:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571706:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390365.571712:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390365.571717:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390365.571729:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571734:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390365.571738:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571744:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be974d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be974da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390365.571760:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390365.571762:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390365.571764:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390365.571778:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097983232:0@lo:103: 00000100:00100000:2.0:1788390365.571824:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390365.571842:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097983744:0@lo:103: 00000100:00100000:2.0:1788390365.571869:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390365.571884:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788390365.571889:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097983360:0@lo:103: 00000100:00100000:2.0:1788390365.571906:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390365.571913:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097983872:0@lo:103: 00000100:00100000:2.0:1788390365.571928:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390365.572163:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097983104 00000100:00100000:0.0:1788390365.572170:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097983104 00010000:00010000:0.0:1788390365.572197:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9757b expref: 24 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390365.572225:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097983232 00000100:00100000:0.0:1788390365.572227:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097983232 00010000:00010000:0.0:1788390365.572237:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97551 expref: 25 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390365.572246:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097983744 00000100:00100000:0.0:1788390365.572248:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097983744 00010000:00010000:0.0:1788390365.572256:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97494 expref: 26 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390365.572265:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097983360 00000100:00100000:0.0:1788390365.572267:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097983360 00010000:00010000:0.0:1788390365.572274:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97535 expref: 27 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390365.572283:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097983872 00000100:00100000:0.0:1788390365.572285:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097983872 00010000:00010000:0.0:1788390365.572293:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9746a expref: 28 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390365.572305:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390365.572311:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+28:3624:x1875263097983104:12345-0@lo:103: 00010000:00010000:0.0:1788390365.572354:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390365.572360:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9757b expref: 28 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572371:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9757b expref: 28 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572386:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf735a00/0xe156d0713be97582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9757b expref: 28 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572406:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390365.572436:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+27:3624:x1875263097983104:12345-0@lo:103: Request processed in 124us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390365.572443:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390365.572493:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390365.572498:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+26:3622:x1875263097983232:12345-0@lo:103: 00010000:00010000:0.0:1788390365.572505:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390365.572509:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97551 expref: 26 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572518:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97551 expref: 26 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572527:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390365.572552:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+26:3622:x1875263097983232:12345-0@lo:103: Request processed in 53us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390365.572557:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390365.572568:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390365.572574:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+25:3622:x1875263097983744:12345-0@lo:103: 00010000:00010000:0.0:1788390365.572580:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390365.572585:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97494 expref: 25 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572594:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97494 expref: 25 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572603:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390365.572625:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+25:3622:x1875263097983744:12345-0@lo:103: Request processed in 52us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390365.572631:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390365.572643:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390365.572647:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263097983360:12345-0@lo:103: 00010000:00010000:0.0:1788390365.572654:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390365.572658:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97535 expref: 24 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572666:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97535 expref: 24 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572676:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390365.572691:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263097983360:12345-0@lo:103: Request processed in 43us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390365.572698:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390365.572707:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788390365.572713:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3622:x1875263097983872:12345-0@lo:103: 00010000:00010000:0.0:1788390365.572719:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390365.572723:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9746a expref: 23 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572730:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9746a expref: 23 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390365.572739:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390365.572758:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3622:x1875263097983872:12345-0@lo:103: Request processed in 46us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390365.572764:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788390365.573236:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097983488:0@lo:103: 00000100:00100000:3.0:1788390365.573272:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390365.573316:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097984000:0@lo:103: 00000100:00100000:3.0:1788390365.573357:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390365.573392:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097983104:0@lo:103: 00000100:00100000:3.0:1788390365.573411:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788390365.573417:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097983616:0@lo:103: 00000100:00100000:3.0:1788390365.573437:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390365.573451:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097984128:0@lo:103: 00000100:00100000:3.0:1788390365.573467:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390365.573483:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097983488 00000100:00100000:3.0:1788390365.573488:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097983488 00010000:00010000:3.0:1788390365.573509:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9750b expref: 23 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.573524:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097984000 00000100:00100000:3.0:1788390365.573526:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097984000 00010000:00010000:3.0:1788390365.573553:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be974e1 expref: 24 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.573573:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097983616 00000100:00100000:3.0:1788390365.573576:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097983616 00010000:00010000:3.0:1788390365.573586:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be974ef expref: 25 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.573594:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097984128 00000100:00100000:3.0:1788390365.573596:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097984128 00010000:00010000:3.0:1788390365.573605:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be974d3 expref: 26 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.573616:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390365.573622:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+26:3624:x1875263097983488:12345-0@lo:103: 00010000:00010000:3.0:1788390365.573631:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390365.573636:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9750b expref: 26 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.573645:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9750b expref: 26 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.573657:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390365.573683:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+26:3624:x1875263097983488:12345-0@lo:103: Request processed in 61us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390365.573689:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390365.573701:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390365.573706:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+25:3624:x1875263097984000:12345-0@lo:103: 00010000:00010000:3.0:1788390365.573713:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390365.573716:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be974e1 expref: 25 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.573735:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be974e1 expref: 25 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.573745:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390365.573765:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+25:3624:x1875263097984000:12345-0@lo:103: Request processed in 59us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390365.573770:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390365.573781:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788390365.573798:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263097983616:12345-0@lo:103: 00010000:00010000:3.0:1788390365.573805:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390365.573809:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be974ef expref: 24 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.573818:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be974ef expref: 24 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.573827:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390365.573844:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263097983616:12345-0@lo:103: Request processed in 47us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390365.573849:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788390365.573877:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788390365.573882:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3624:x1875263097984128:12345-0@lo:103: 00010000:00010000:3.0:1788390365.573888:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390365.573892:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be974d3 expref: 23 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.573901:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be974d3 expref: 23 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.573915:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390365.573933:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3624:x1875263097984128:12345-0@lo:103: Request processed in 51us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390365.573939:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788390365.573957:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390365.573970:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097983616:0@lo:103: 00000100:00100000:3.0:1788390365.573977:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097984128:0@lo:103: 00000100:00100000:3.0:1788390365.573984:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097983488:0@lo:103: 00000100:00100000:3.0:1788390365.573996:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097984000:0@lo:103: 00010000:00010000:1.0:1788390365.574179:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b4400/0xe156d0713be97558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97551 expref: 22 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.574193:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982080:0@lo:104: 00010000:00010000:1.0:1788390365.574212:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b5600/0xe156d0713be9753c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97535 expref: 21 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.574221:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982208:0@lo:104: 00010000:00010000:1.0:1788390365.574230:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cfa00/0xe156d0713be97512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9750b expref: 20 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.574238:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982336:0@lo:104: 00010000:00010000:1.0:1788390365.574247:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cf600/0xe156d0713be974f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be974ef expref: 19 pid: 6484 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.574255:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982464:0@lo:104: 00010000:00010000:1.0:1788390365.574262:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cf800/0xe156d0713be974e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be974e1 expref: 18 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.574269:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982592:0@lo:104: 00010000:00010000:1.0:1788390365.574508:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b5400/0xe156d0713be974da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be974d3 expref: 17 pid: 6487 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390365.574517:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982720:0@lo:104: 00010000:00010000:0.0:1788390365.574724:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80030200/0xe156d0713be9749b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97494 expref: 16 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390365.574737:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982848:0@lo:104: 00010000:00010000:0.0:1788390365.574748:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cf400/0xe156d0713be97471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9746a expref: 15 pid: 6486 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390365.574757:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097982976:0@lo:104: 00000100:00100000:2.0:1788390365.575029:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097983360:0@lo:103: 00000100:00100000:2.0:1788390365.575039:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097983872:0@lo:103: 00000100:00100000:2.0:1788390365.575047:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097983232:0@lo:103: 00000100:00100000:2.0:1788390365.575055:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097983744:0@lo:103: 00000100:00100000:0.0:1788390365.575972:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390365.576041:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097981696:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390365.576051:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875263097981824:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390365.576102:0:10304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390365.576168:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390365.576279:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088497408 00000100:00100000:3.0:1788390365.576295:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088497408 00010000:00010000:3.0:1788390365.576365:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c11 expref: 10 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.576392:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088497536 00000100:00100000:3.0:1788390365.576395:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088497536 00010000:00010000:3.0:1788390365.576406:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c0a expref: 11 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390365.576420:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:3.0:1788390365.576428:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+11:2405:x1875263088497408:12345-192.168.202.11@tcp:103: 00010000:00010000:3.0:1788390365.576444:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390365.576450:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c11 expref: 11 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576461:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c11 expref: 11 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576491:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d4400/0xe156d0713be97597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c11 expref: 11 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576505:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390365.576564:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2405:x1875263088497408:12345-192.168.202.11@tcp:103: Request processed in 136us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390365.576571:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:3.0:1788390365.576586:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 34 00000100:00100000:3.0:1788390365.576592:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+9:2405:x1875263088497536:12345-192.168.202.11@tcp:103: 00010000:00010000:3.0:1788390365.576599:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390365.576603:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c0a expref: 9 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576613:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c0a expref: 9 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576623:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d5a00/0xe156d0713be97590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c0a expref: 9 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576634:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576643:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576659:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576677:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576686:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576694:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576700:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4a00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390365.576704:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576714:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576730:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390365.576739:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390365.576760:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+8:2405:x1875263088497536:12345-192.168.202.11@tcp:103: Request processed in 168us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390365.576767:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 34 00010000:00010000:1.0:1788390365.577251:0:10304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.577274:0:10304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390365.577451:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d4a00/0xe156d0713be975d6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390365.777871:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390365.777908:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097984256:0@lo:13: 00000100:00100000:2.0:1788390365.777998:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390365.778050:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097984384:0@lo:41: 00000100:00100000:2.0:1788390365.778093:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390365.778184:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097984512:0@lo:13: 00000100:00100000:0.0:1788390365.778188:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390365.778222:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390365.778307:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097984384 00000100:00100000:2.0:1788390365.778316:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097984384 00000100:00100000:3.0:1788390365.778384:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097984256 00000100:00100000:3.0:1788390365.778390:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097984256 00000100:00100000:2.0:1788390365.778394:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788390365.778406:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097984384:12345-0@lo:41: 00000100:00100000:3.0:1788390365.778442:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097984512 00000100:00100000:3.0:1788390365.778447:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097984512 00000004:00000024:2.0:1788390365.778448:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788390365.778485:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788390365.778497:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097984256:12345-0@lo:13: 00000100:00100000:2.0:1788390365.778504:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097984384:12345-0@lo:41: Request processed in 98us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.778511:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00002000:00000024:3.0:1788390365.778548:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390365.778563:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097984384:0@lo:41: 00000100:00100000:3.0:1788390365.778594:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097984256:12345-0@lo:13: Request processed in 99us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390365.778603:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788390365.778607:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390365.778622:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788390365.778719:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097984512:12345-0@lo:13: 00002000:00000024:2.0:1788390365.778738:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390365.778765:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097984512:12345-0@lo:13: Request processed in 136us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390365.778771:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788390365.779505:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb16ca80 x1875263097984512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390365.779528:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097984512:0@lo:13: 00010000:00080000:2.0:1788390365.779596:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1901f80 x1875263097984256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390365.779610:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097984256:0@lo:13: 00000100:00100000:2.0:1788390366.289615:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097984640:0@lo:13: 00000100:00100000:2.0:1788390366.289715:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390366.290053:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097984640 00000100:00100000:3.0:1788390366.290066:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097984640 00000100:00100000:3.0:1788390366.290148:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390366.290163:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097984640:12345-0@lo:13: 00002000:00000024:3.0:1788390366.290205:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390366.290247:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097985152:0@lo:13: 00000100:00100000:3.0:1788390366.290269:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097984640:12345-0@lo:13: Request processed in 110us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390366.290278:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788390366.290285:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390366.290307:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097985152 00000100:00100000:3.0:1788390366.290341:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097985152 00000100:00100000:3.0:1788390366.290367:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390366.290375:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875263097985152:12345-0@lo:13: 00010000:00080000:2.0:1788390366.290377:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1903100 x1875263097984640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1788390366.290387:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390366.290391:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788390366.290420:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097984640:0@lo:13: 00000100:00100000:3.0:1788390366.290422:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875263097985152:12345-0@lo:13: Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390366.290431:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788390366.290451:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788390366.290451:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e878b1180 x1875263097985152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390366.290465:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097985152:0@lo:13: 00000100:00100000:2.0:1788390366.290476:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390366.290483:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263097985024:0@lo:400: 00000100:00100000:2.0:1788390366.290513:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390366.290571:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097984768:0@lo:400: 00000100:00100000:2.0:1788390366.290581:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097985024 00000100:00100000:2.0:1788390366.290585:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097985024 00000100:00100000:3.0:1788390366.290603:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390366.290628:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097984768 00000100:00100000:3.0:1788390366.290629:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390366.290632:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097984768 00000100:00100000:3.0:1788390366.290637:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097984896:0@lo:400: 00000100:00100000:3.0:1788390366.290668:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390366.290675:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788390366.290685:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263097985024:12345-0@lo:400: 00000100:00100000:3.0:1788390366.290728:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788390366.290733:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263097985024:12345-0@lo:400: Request processed in 46us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390366.290744:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097984768:12345-0@lo:400: 00000100:00100000:2.0:1788390366.290744:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788390366.290789:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263097985024:0@lo:400: 00000100:00100000:3.0:1788390366.290807:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097984768:12345-0@lo:400: Request processed in 68us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390366.290815:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788390366.290826:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097984768:0@lo:400: 00000100:00100000:3.0:1788390366.292568:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097984896 00000100:00100000:3.0:1788390366.292589:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097984896 00000100:00100000:3.0:1788390366.292668:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390366.292679:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097984896:12345-0@lo:400: 00000100:00100000:3.0:1788390366.292769:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097984896:12345-0@lo:400: Request processed in 92us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390366.292788:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788390366.294082:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263097985280:0@lo:400: 00000100:00100000:2.0:1788390366.294167:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390366.294247:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097984896:0@lo:400: 00000100:00100000:2.0:1788390366.294275:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390366.294282:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263097985408:0@lo:400: 00000100:00100000:2.0:1788390366.294308:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390366.294361:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097985280 00000100:00100000:2.0:1788390366.294369:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097985280 00000100:00100000:2.0:1788390366.294429:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097985408 00000100:00100000:2.0:1788390366.294433:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097985408 00000100:00100000:2.0:1788390366.294458:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788390366.294470:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263097985280:12345-0@lo:400: 00000100:00100000:2.0:1788390366.294529:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263097985280:12345-0@lo:400: Request processed in 60us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390366.294536:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788390366.294570:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788390366.294577:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263097985408:12345-0@lo:400: 00000100:00100000:2.0:1788390366.294618:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263097985408:12345-0@lo:400: Request processed in 41us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390366.294642:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788390366.294667:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788390366.294672:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390366.294690:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263097985664:0@lo:400: 00000100:00100000:2.0:1788390366.294718:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390366.294736:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390366.294741:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263097985536:0@lo:400: 00000100:00100000:2.0:1788390366.294759:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390366.294805:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097985664 00000100:00100000:2.0:1788390366.294810:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097985664 00000100:00100000:2.0:1788390366.294834:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097985536 00000100:00100000:2.0:1788390366.294837:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097985536 00000100:00100000:2.0:1788390366.294853:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788390366.294858:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263097985664:12345-0@lo:400: 00000100:00100000:2.0:1788390366.294892:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263097985664:12345-0@lo:400: Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390366.294898:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788390366.294909:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788390366.294914:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263097985536:12345-0@lo:400: 00000100:00100000:2.0:1788390366.294942:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263097985536:12345-0@lo:400: Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390366.294948:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788390366.294960:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390366.294963:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788390366.294985:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263097985536:0@lo:400: 00010000:00080000:2.0:1788390366.294997:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1901c00 x1875263097985664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390366.295020:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263097985664:0@lo:400: 00010000:00080000:2.0:1788390366.295047:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1900e00 x1875263097985408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390366.295055:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263097985408:0@lo:400: 00000100:00100000:2.0:1788390366.295066:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263097985280:0@lo:400: 00010000:00010000:2.0:1788390366.353596:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788390367.323938:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 10000000:01000000:3.0:1788390367.377475:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788390367.377487:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fc18b3800 from 48 10000000:01000000:3.0:1788390367.377495:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390367.377575:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.377589:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.377603:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390367.377637:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097985792:0@lo:101: 00000100:00100000:3.0:1788390367.377742:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390367.377853:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390367.377909:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.378013:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097985792 00000100:00100000:0.0:1788390367.378023:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097985792 00000100:00100000:0.0:1788390367.378139:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788390367.378151:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+15:6489:x1875263097985792:12345-0@lo:101: 00010000:00010000:0.0:1788390367.378168:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390367.378184:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f80030200/0xe156d0713be975e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be975dd expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.378223:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f80030200/0xe156d0713be975e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be975dd expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.378236:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f80030200/0xe156d0713be975e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be975dd expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.378247:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f80030200, rc 0) 00000100:00100000:0.0:1788390367.378303:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097985792:12345-0@lo:101: Request processed in 154us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.378357:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788390367.378459:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097985792:0@lo:101: 00010000:00010000:3.0:1788390367.378485:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.378495:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390367.378570:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097985920:0@lo:501: 00000100:00100000:3.0:1788390367.378598:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390367.378793:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390367.378949:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097985920 00000100:00100000:2.0:1788390367.378955:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097985920 00000100:00100000:2.0:1788390367.378996:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788390367.379004:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097985920:12345-0@lo:501: 00000100:00100000:2.0:1788390367.379174:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097985920:12345-0@lo:501: Request processed in 171us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390367.379181:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788390367.379313:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097985920:0@lo:501: 00000100:00100000:3.0:1788390367.379364:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097986048:0@lo:503: 00000100:00100000:3.0:1788390367.379412:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390367.379437:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390367.379471:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097986048 00000100:00100000:2.0:1788390367.379476:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097986048 00000100:00100000:2.0:1788390367.379496:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788390367.379503:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097986048:12345-0@lo:503: 00000100:00100000:3.0:1788390367.380212:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097986048:0@lo:503: 00000100:00100000:2.0:1788390367.380367:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097986048:12345-0@lo:503: Request processed in 644us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390367.380376:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788390367.381350:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10322:1875263097986176:0@lo:502: 00000100:00100000:2.0:1788390367.381417:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390367.381461:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.381471:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097986176 00000100:00100000:0.0:1788390367.381480:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097986176 00000100:00100000:0.0:1788390367.381526:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788390367.381534:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:10322:x1875263097986176:12345-0@lo:502: 00000100:00100000:0.0:1788390367.381654:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:10322:x1875263097986176:12345-0@lo:502: Request processed in 120us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.381659:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788390367.381887:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10322:1875263097986176:0@lo:502: 00000100:00100000:2.0:1788390367.381941:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10322:1875263097986304:0@lo:502: 00000100:00100000:2.0:1788390367.381976:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390367.382004:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.382125:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097986304 00000100:00100000:1.0:1788390367.382138:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097986304 00000100:00100000:1.0:1788390367.382197:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788390367.382205:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:10322:x1875263097986304:12345-0@lo:502: 00000100:00100000:1.0:1788390367.382407:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+16:10322:x1875263097986304:12345-0@lo:502: Request processed in 199us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.382417:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788390367.382429:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10322:1875263097986304:0@lo:502: 00000040:00080000:2.0:1788390367.382464:0:10322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788390367.382962:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788390367.382992:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788390367.383004:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.383016:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390367.383028:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788390367.383031:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788390367.383034:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788390367.383133:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.383155:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.383167:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390367.383184:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097986432:0@lo:101: 00000100:00100000:3.0:1788390367.383250:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390367.383297:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.383360:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097986432 00000100:00100000:0.0:1788390367.383370:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097986432 00000100:00100000:0.0:1788390367.383428:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788390367.383437:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+16:6489:x1875263097986432:12345-0@lo:101: 00010000:00010000:0.0:1788390367.383449:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390367.383466:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f80030a00/0xe156d0713be975f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be975eb expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.383492:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f80030a00/0xe156d0713be975f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be975eb expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.383502:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f80030a00/0xe156d0713be975f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be975eb expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.383512:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f80030a00, rc 0) 00000100:00100000:0.0:1788390367.383567:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097986432:12345-0@lo:101: Request processed in 131us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.383573:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788390367.383626:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097986432:0@lo:101: 00010000:00010000:0.0:1788390367.383666:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.383676:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390367.383758:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097986560:0@lo:501: 00000100:00100000:0.0:1788390367.383798:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.383827:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f99dc7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.383840:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097986560 00000100:00100000:0.0:1788390367.383843:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097986560 00000100:00100000:0.0:1788390367.383888:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788390367.383899:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097986560:12345-0@lo:501: 00000100:00100000:0.0:1788390367.384029:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097986560:12345-0@lo:501: Request processed in 132us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.384036:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788390367.384096:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097986560:0@lo:501: 00000100:00100000:3.0:1788390367.384141:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097986688:0@lo:503: 00000100:00100000:3.0:1788390367.384964:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390367.385076:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.385133:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097986688 00000100:00100000:0.0:1788390367.385140:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097986688 00000100:00100000:0.0:1788390367.385193:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788390367.385216:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097986688:12345-0@lo:503: 00000100:00100000:0.0:1788390367.385408:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097986688:12345-0@lo:503: Request processed in 195us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.385416:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788390367.385989:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097986688:0@lo:503: 00000100:00100000:3.0:1788390367.387436:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10323:1875263097986816:0@lo:502: 00000100:00100000:3.0:1788390367.387670:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.387780:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097986816 00000100:00100000:0.0:1788390367.387787:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097986816 00000100:00100000:0.0:1788390367.387844:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788390367.387855:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:10323:x1875263097986816:12345-0@lo:502: 00000100:00100000:0.0:1788390367.388073:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+17:10323:x1875263097986816:12345-0@lo:502: Request processed in 219us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.388081:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788390367.388726:0:10323:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.388754:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10323:1875263097986816:0@lo:502: 00000020:01000000:3.0:1788390367.388798:0:10323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390367.388810:0:10323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390367.388812:0:10323:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788390367.388818:0:10323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788390367.388846:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10323:1875263097986944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390367.388890:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390367.388913:0:10323:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.388975:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097986944 00000100:00100000:0.0:1788390367.388980:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097986944 00000100:00100000:0.0:1788390367.389023:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788390367.389031:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:10323:x1875263097986944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.389116:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+17:10323:x1875263097986944:12345-0@lo:502:llog_process_th.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.389123:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788390367.389466:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10323:1875263097986944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788390367.389486:0:10323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390367.389491:0:10323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390367.389493:0:10323:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788390367.389496:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788390367.389796:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788390367.389824:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788390367.389836:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.389849:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390367.389860:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788390367.389863:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fb7b73800 from 48 10000000:01000000:0.0:1788390367.389866:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788390367.389901:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.389910:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.389920:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390367.389952:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.389994:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.390029:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb31a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.390450:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097987072 00000100:00100000:1.0:1788390367.390457:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097987072 00000100:00100000:1.0:1788390367.390504:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788390367.390520:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+17:6489:x1875263097987072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390367.390532:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390367.390547:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4a00/0xe156d0713be97600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be975f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.390681:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4a00/0xe156d0713be97600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be975f9 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.390701:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4a00/0xe156d0713be97600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be975f9 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.390711:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4a00, rc 0) 00000100:00100000:1.0:1788390367.390755:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097987072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.390761:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788390367.391523:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390367.391543:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.391553:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390367.391731:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.391782:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.391814:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb31a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.391911:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097987200 00000100:00100000:1.0:1788390367.391916:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097987200 00000100:00100000:1.0:1788390367.391951:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788390367.391959:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097987200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.392096:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097987200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.392103:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788390367.392356:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.392383:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.392428:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.392449:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb31a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.392510:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097987328 00000100:00100000:3.0:1788390367.392521:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097987328 00000100:00100000:3.0:1788390367.392552:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788390367.392559:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097987328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390367.392653:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097987328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.392660:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788390367.392922:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390367.395654:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10324:1875263097987456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390367.395789:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390367.395840:0:10324:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.396169:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097987456 00000100:00100000:1.0:1788390367.396179:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097987456 00000100:00100000:1.0:1788390367.396695:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788390367.396709:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:10324:x1875263097987456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390367.396916:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+18:10324:x1875263097987456:12345-0@lo:502:llog_process_th.0 Request processed in 211us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.396926:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788390367.397166:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10324:1875263097987456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.397244:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10324:1875263097987584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.397290:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.397351:0:10324:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb31a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.398058:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097987584 00000100:00100000:3.0:1788390367.398067:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097987584 00000100:00100000:3.0:1788390367.398120:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788390367.398128:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:10324:x1875263097987584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390367.398927:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+18:10324:x1875263097987584:12345-0@lo:502:llog_process_th.0 Request processed in 794us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.398938:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788390367.399176:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10324:1875263097987584:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788390367.399243:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788390367.399916:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788390367.399952:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788390367.399966:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390367.399982:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390367.399995:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788390367.399998:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788390367.400002:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788390367.400050:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390367.400059:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390367.400070:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390367.400097:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390367.400167:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390367.400225:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.400344:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097987712 00000100:00100000:1.0:1788390367.400353:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097987712 00000100:00100000:1.0:1788390367.400413:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788390367.400423:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+18:6489:x1875263097987712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390367.400437:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390367.400450:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5400/0xe156d0713be9760e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97607 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.400477:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5400/0xe156d0713be9760e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97607 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.400489:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5400/0xe156d0713be9760e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97607 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.400499:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5400, rc 0) 00000100:00100000:1.0:1788390367.400549:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097987712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.400557:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788390367.402303:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390367.402381:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390367.402396:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390367.402550:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390367.402915:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390367.402958:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.403249:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097987840 00000100:00100000:0.0:1788390367.403259:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097987840 00000100:00100000:0.0:1788390367.403316:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788390367.403347:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097987840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.403550:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097987840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.403559:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788390367.406869:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.406973:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.407085:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390367.407144:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f8a2bf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788390367.407668:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097987968 00000100:00100000:2.0:1788390367.407679:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097987968 00000100:00100000:2.0:1788390367.407746:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788390367.407758:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097987968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390367.407938:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097987968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390367.407947:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788390367.408453:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097987968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.410114:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10325:1875263097988096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390367.410231:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390367.410282:0:10325:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390367.410470:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097988096 00000100:00100000:2.0:1788390367.410479:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097988096 00000100:00100000:2.0:1788390367.410540:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788390367.410552:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:10325:x1875263097988096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390367.410722:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+19:10325:x1875263097988096:12345-0@lo:502:llog_process_th.0 Request processed in 171us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390367.410730:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788390367.410916:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10325:1875263097988096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390367.410949:0:10325:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390367.410959:0:10325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390367.410962:0:10325:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788390367.410967:0:10325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788390367.410990:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10325:1875263097988224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.411027:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.411057:0:10325:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb31a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.411163:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097988224 00000100:00100000:1.0:1788390367.411167:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097988224 00000100:00100000:1.0:1788390367.411217:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788390367.411223:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:10325:x1875263097988224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390367.411296:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:10325:x1875263097988224:12345-0@lo:502:llog_process_th.0 Request processed in 73us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.411302:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788390367.412115:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10325:1875263097988224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390367.412152:0:10325:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390367.412160:0:10325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390367.412162:0:10325:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788390367.412167:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788390367.412795:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788390367.412823:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788390367.412844:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390367.412868:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390367.412880:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788390367.412883:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fb76a1000 from 48 10000000:01000000:2.0:1788390367.412887:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788390367.412926:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390367.412935:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390367.412947:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390367.412968:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097988352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390367.413034:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390367.413069:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.414640:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097988352 00000100:00100000:1.0:1788390367.414655:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097988352 00000100:00100000:1.0:1788390367.414729:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788390367.414741:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:6489:x1875263097988352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390367.414759:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390367.414788:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5800/0xe156d0713be9761c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97615 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.414819:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5800/0xe156d0713be9761c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97615 expref: 20 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.414830:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5800/0xe156d0713be9761c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97615 expref: 20 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.414851:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5800, rc 0) 00000100:00100000:1.0:1788390367.414951:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097988352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.414959:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788390367.415298:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097988352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390367.415379:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.415392:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390367.415527:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097988480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.415946:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.416075:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb31a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390367.417019:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097988480 00000100:00100000:2.0:1788390367.417031:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097988480 00000100:00100000:0.0:1788390367.417272:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788390367.417284:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097988480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.417748:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097988480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 464us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.417757:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788390367.417862:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097988480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390367.417918:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097988608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390367.417975:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390367.418142:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.419630:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097988608 00000100:00100000:1.0:1788390367.419655:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097988608 00000100:00100000:3.0:1788390367.419710:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788390367.419761:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097988608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390367.420060:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097988608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 305us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390367.420124:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097988608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390367.420642:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10326:1875263097988736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390367.420707:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390367.420746:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.420911:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097988736 00000100:00100000:0.0:1788390367.420917:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097988736 00000100:00100000:3.0:1788390367.422258:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788390367.422466:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788390367.422481:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:10326:x1875263097988736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.422756:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:10326:x1875263097988736:12345-0@lo:502:llog_process_th.0 Request processed in 279us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.422764:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788390367.422916:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10326:1875263097988736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390367.422984:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10326:1875263097988864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390367.423030:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390367.423105:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086300 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.423139:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097988864 00000100:00100000:3.0:1788390367.423145:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097988864 00000100:00100000:3.0:1788390367.423293:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788390367.423302:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:10326:x1875263097988864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390367.423420:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:10326:x1875263097988864:12345-0@lo:502:llog_process_th.0 Request processed in 120us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.423428:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788390367.423510:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10326:1875263097988864:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788390367.423531:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788390367.423813:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788390367.423853:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788390367.423866:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.423879:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390367.423891:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788390367.423894:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788390367.423904:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788390367.423937:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.423946:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.423957:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390367.423974:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097988992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.424010:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.424381:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.424497:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097988992 00000100:00100000:1.0:1788390367.424504:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097988992 00000100:00100000:1.0:1788390367.424542:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788390367.424551:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097988992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390367.424569:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390367.424661:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4600/0xe156d0713be9762a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97623 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.424691:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4600/0xe156d0713be9762a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97623 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.424703:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4600/0xe156d0713be9762a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97623 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.424715:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4600, rc 0) 00000100:00100000:1.0:1788390367.424764:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097988992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.424781:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788390367.424952:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097988992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390367.424968:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.424978:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390367.425041:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.425069:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.425097:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.425143:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097989120 00000100:00100000:1.0:1788390367.425146:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097989120 00000100:00100000:1.0:1788390367.425174:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788390367.425180:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097989120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.425425:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097989120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.425432:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788390367.425563:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.425606:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.425652:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.425668:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.425775:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097989248 00000100:00100000:1.0:1788390367.425780:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097989248 00000100:00100000:1.0:1788390367.425810:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788390367.425817:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097989248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.426008:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097989248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.426022:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788390367.426090:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390367.426736:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10327:1875263097989376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390367.426789:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390367.426899:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390367.426938:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097989376 00000100:00100000:2.0:1788390367.426944:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097989376 00000100:00100000:2.0:1788390367.427014:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788390367.427023:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10327:x1875263097989376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390367.427125:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10327:x1875263097989376:12345-0@lo:502:llog_process_th.0 Request processed in 103us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390367.427131:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788390367.427207:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10327:1875263097989376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788390367.427233:0:10327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390367.427243:0:10327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390367.427246:0:10327:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788390367.427253:0:10327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788390367.427273:0:10327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10327:1875263097989504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390367.427305:0:10327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390367.430188:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097989504 00000100:00100000:1.0:1788390367.430265:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097989504 00000100:00100000:0.0:1788390367.430417:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788390367.430429:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10327:x1875263097989504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390367.430713:0:10327:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.430922:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10327:x1875263097989504:12345-0@lo:502:llog_process_th.0 Request processed in 494us (3615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.430931:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788390367.431061:0:10327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10327:1875263097989504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390367.431102:0:10327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390367.431112:0:10327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390367.431114:0:10327:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788390367.431120:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788390367.431811:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788390367.431835:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788390367.431908:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.431922:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390367.431935:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788390367.431939:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984f988e6800 from 48 10000000:01000000:0.0:1788390367.431942:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788390367.431984:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.431993:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.432004:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390367.432029:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.432082:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.432127:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.432186:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097989632 00000100:00100000:3.0:1788390367.432193:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097989632 00000100:00100000:3.0:1788390367.432292:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788390367.432301:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097989632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390367.432314:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390367.432355:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf734a00/0xe156d0713be97638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97631 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.432396:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf734a00/0xe156d0713be97638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97631 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.432408:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf734a00/0xe156d0713be97638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97631 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.432419:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf734a00, rc 0) 00000100:00100000:3.0:1788390367.432460:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097989632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.432466:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788390367.432552:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390367.432566:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.432577:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390367.432655:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.432684:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390367.432709:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.432814:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097989760 00000100:00100000:3.0:1788390367.432819:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097989760 00000100:00100000:3.0:1788390367.432860:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788390367.432867:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097989760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390367.433016:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097989760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.433024:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788390367.433164:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.433279:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.433316:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390367.433350:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.433493:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097989888 00000100:00100000:3.0:1788390367.433497:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097989888 00000100:00100000:3.0:1788390367.433527:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788390367.433534:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097989888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390367.433674:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097989888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.433681:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788390367.433756:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097989888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.434283:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10328:1875263097990016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.434381:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.434411:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.434510:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097990016 00000100:00100000:3.0:1788390367.434515:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097990016 00000100:00100000:3.0:1788390367.434555:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788390367.434563:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:10328:x1875263097990016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390367.434732:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:10328:x1875263097990016:12345-0@lo:502:llog_process_th.0 Request processed in 169us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.434740:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788390367.434914:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10328:1875263097990016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.434962:0:10328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10328:1875263097990144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.434996:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.435021:0:10328:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a5c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.435063:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097990144 00000100:00100000:1.0:1788390367.435074:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097990144 00000100:00100000:1.0:1788390367.435110:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788390367.435117:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+22:10328:x1875263097990144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390367.435193:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+22:10328:x1875263097990144:12345-0@lo:502:llog_process_th.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.435265:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788390367.435358:0:10328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10328:1875263097990144:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788390367.435376:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788390367.435541:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788390367.435566:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390367.435576:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.435645:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390367.435657:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788390367.435660:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788390367.435664:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788390367.435692:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.435700:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.435708:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390367.435721:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097990272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.435752:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390367.435788:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.435905:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097990272 00000100:00100000:3.0:1788390367.435910:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097990272 00000100:00100000:3.0:1788390367.435940:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788390367.435947:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097990272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390367.435958:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390367.435971:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf735600/0xe156d0713be97646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9763f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.435995:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf735600/0xe156d0713be97646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9763f expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.436006:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf735600/0xe156d0713be97646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9763f expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390367.436015:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735600, rc 0) 00000100:00100000:3.0:1788390367.436048:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097990272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.436054:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788390367.436125:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097990272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390367.436139:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.436148:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390367.436294:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097990400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.436484:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.436576:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.436682:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097990400 00000100:00100000:3.0:1788390367.436687:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097990400 00000100:00100000:3.0:1788390367.436746:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788390367.436754:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097990400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390367.437005:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097990400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.437036:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788390367.437093:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097990400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.437127:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097990528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.437169:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390367.437271:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097990528 00000100:00100000:1.0:1788390367.437276:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097990528 00000100:00100000:1.0:1788390367.437310:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788390367.437317:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097990528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.437430:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097990528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.437436:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788390367.437523:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a5c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.437554:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097990528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.438107:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10329:1875263097990656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.438148:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.438280:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390367.438316:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097990656 00000100:00100000:3.0:1788390367.438464:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097990656 00000100:00100000:3.0:1788390367.438532:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788390367.438540:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10329:x1875263097990656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390367.438660:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10329:x1875263097990656:12345-0@lo:502:llog_process_th.0 Request processed in 121us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390367.438667:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788390367.438726:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10329:1875263097990656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390367.438755:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390367.438777:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390367.438780:0:10329:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788390367.438787:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788390367.438818:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10329:1875263097990784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390367.438866:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390367.439062:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a5c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788390367.439133:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097990784 00000100:00100000:1.0:1788390367.439137:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097990784 00000100:00100000:1.0:1788390367.439157:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788390367.439162:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10329:x1875263097990784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390367.439247:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10329:x1875263097990784:12345-0@lo:502:llog_process_th.0 Request processed in 83us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390367.439254:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788390367.439385:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10329:1875263097990784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390367.439403:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390367.439408:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390367.439410:0:10329:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788390367.439413:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788390367.439573:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788390367.439605:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788390367.439618:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.439642:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390367.439655:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788390367.439658:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984f88c4cd28 from 1 10000000:01000000:1.0:1788390367.439661:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788390367.439692:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.439700:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.439708:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390367.439723:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097990912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.439754:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390367.439789:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b250c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.439931:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097990912 00000100:00100000:0.0:1788390367.439937:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097990912 00000100:00100000:0.0:1788390367.439962:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788390367.439969:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097990912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390367.439980:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390367.439996:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf63ce00/0xe156d0713be97654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9764d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.440022:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf63ce00/0xe156d0713be97654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9764d expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.440033:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf63ce00/0xe156d0713be97654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9764d expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390367.440043:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63ce00, rc 0) 00000100:00100000:0.0:1788390367.440084:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097990912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390367.440091:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788390367.440162:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097990912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390367.440177:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97654 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.440188:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97654 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390367.440255:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097991040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390367.440281:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390367.440404:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b250c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390367.440466:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097991040 00000100:00100000:0.0:1788390367.440470:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097991040 00000100:00100000:0.0:1788390367.440487:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788390367.440500:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097991040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390367.440574:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097991040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (292us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390367.440591:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788390367.440705:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097991040:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788390367.440726:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788390367.440732:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97654 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390367.440740:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97654 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390368.401542:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390368.851109:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097991168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788390368.851216:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390368.851814:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097991168 00000100:00100000:2.0:1788390368.851832:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097991168 00000100:00100000:2.0:1788390368.851913:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788390368.851925:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097991168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390368.852039:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788390368.852139:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097991168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 217us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390368.852147:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788390368.852234:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097991168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788390369.046539:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390369.046602:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390369.046638:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390369.046750:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390369.046805:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088498048 00000100:00100000:0.0:1788390369.046818:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088498048 00000100:00100000:0.0:1788390369.046895:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:0.0:1788390369.046908:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088498048:12345-192.168.202.11@tcp:400: 00000100:00100000:0.0:1788390369.047000:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088498048:12345-192.168.202.11@tcp:400: Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390369.047008:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:3.0:1788390369.047192:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088497792 00000100:00100000:3.0:1788390369.047198:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088497792 00000100:00100000:3.0:1788390369.047231:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088497920 00000100:00100000:3.0:1788390369.047234:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088497920 00000100:00100000:3.0:1788390369.047258:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:3.0:1788390369.047267:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088497792:12345-192.168.202.11@tcp:400: 00000100:00100000:3.0:1788390369.047426:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088497792:12345-192.168.202.11@tcp:400: Request processed in 160us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390369.047434:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:3.0:1788390369.047449:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:3.0:1788390369.047456:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088497920:12345-192.168.202.11@tcp:400: 00000100:00100000:3.0:1788390369.047487:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088497920:12345-192.168.202.11@tcp:400: Request processed in 31us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390369.047493:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00080000:2.0:1788390369.047738:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788390369.047771:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390369.047774:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390369.047861:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088497664 00000100:00100000:1.0:1788390369.047868:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088497664 00000100:00100000:1.0:1788390369.047914:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 240 00000100:00100000:1.0:1788390369.047922:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+8:2405:x1875263088497664:12345-192.168.202.11@tcp:400: 00000100:00100000:1.0:1788390369.048040:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+8:2405:x1875263088497664:12345-192.168.202.11@tcp:400: Request processed in 118us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390369.048059:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 240 00000100:00100000:0.0:1788390369.055213:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390369.055363:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088498176 00000100:00100000:2.0:1788390369.055376:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088498176 00000100:00100000:2.0:1788390369.055520:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:2.0:1788390369.055535:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088498176:12345-192.168.202.11@tcp:400: 00000100:00100000:2.0:1788390369.055643:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088498176:12345-192.168.202.11@tcp:400: Request processed in 112us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390369.055652:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00080000:0.0:1788390369.055960:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788390369.427775:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390370.449717:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390370.897716:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097991296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390370.897785:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097991552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390370.897858:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390370.897864:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097991424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390370.897928:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097991296 00000100:00100000:3.0:1788390370.897951:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097991296 00000100:00100000:1.0:1788390370.897984:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390370.898018:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390370.898031:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097991296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390370.898061:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788390370.898110:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390370.898128:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097991296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390370.898136:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390370.898143:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097991424 00010000:00080000:0.0:1788390370.898154:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb16dc00 x1875263097991296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390370.898158:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097991424 00000100:00100000:0.0:1788390370.898188:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097991296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390370.898213:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390370.898223:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097991424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788390370.898256:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788390370.898302:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097991424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390370.898315:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788390370.898415:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097991424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788390370.900391:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390370.900572:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097991552 00000100:00100000:3.0:1788390370.900584:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097991552 00000100:00100000:3.0:1788390370.900682:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390370.900693:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097991552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390370.900796:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390370.900881:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097991552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390370.900889:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788390370.900979:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1901180 x1875263097991552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390370.901003:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097991552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390370.901095:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390371.092497:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390371.094783:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088498304 00000100:00100000:1.0:1788390371.094802:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088498304 00000100:00100000:1.0:1788390371.094893:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 241 00000100:00100000:1.0:1788390371.094905:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+8:6169:x1875263088498304:12345-192.168.202.11@tcp:101: 00010000:00010000:1.0:1788390371.094929:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390371.094956:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4e00/0xe156d0713be9765b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243c81 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390371.094997:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4e00/0xe156d0713be9765b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c81 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390371.095007:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4e00/0xe156d0713be9765b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c81 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390371.095016:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4e00, rc 0) 00000100:00100000:1.0:1788390371.095093:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6169:x1875263088498304:12345-192.168.202.11@tcp:101: Request processed in 191us (2614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390371.095098:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 241 00000100:00100000:1.0:1788390371.098957:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390371.099062:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088498432 00000100:00100000:0.0:1788390371.099076:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088498432 00000100:00100000:0.0:1788390371.099143:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 242 00000100:00100000:0.0:1788390371.099156:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6169:x1875263088498432:12345-192.168.202.11@tcp:501: 00000100:00100000:0.0:1788390371.099391:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6169:x1875263088498432:12345-192.168.202.11@tcp:501: Request processed in 236us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390371.099400:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 242 00000100:00100000:0.0:1788390371.101422:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390371.101520:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088498560 00000100:00100000:1.0:1788390371.101531:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088498560 00000100:00100000:1.0:1788390371.101698:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 243 00000100:00100000:1.0:1788390371.101710:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6169:x1875263088498560:12345-192.168.202.11@tcp:503: 00000100:00100000:1.0:1788390371.101896:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6169:x1875263088498560:12345-192.168.202.11@tcp:503: Request processed in 188us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390371.103828:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 243 00000100:00100000:2.0:1788390371.107717:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390371.107854:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088498688 00000100:00100000:0.0:1788390371.107867:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088498688 00000100:00100000:0.0:1788390371.107946:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 244 00000100:00100000:0.0:1788390371.107958:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6673:x1875263088498688:12345-192.168.202.11@tcp:502: 00000100:00100000:0.0:1788390371.108174:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6673:x1875263088498688:12345-192.168.202.11@tcp:502: Request processed in 217us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390371.108182:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 244 00000100:00100000:0.0:1788390371.112007:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390371.112115:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088498816 00000100:00100000:1.0:1788390371.112129:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088498816 00000100:00100000:1.0:1788390371.112296:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 245 00000100:00100000:1.0:1788390371.112308:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6673:x1875263088498816:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390371.112547:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6673:x1875263088498816:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 240us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390371.112556:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 245 00000100:00100000:1.0:1788390371.116445:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390371.116509:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088498944 00000100:00100000:3.0:1788390371.116523:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088498944 00000100:00100000:3.0:1788390371.116608:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 246 00000100:00100000:3.0:1788390371.116621:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6169:x1875263088498944:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390371.116646:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390371.116670:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf735a00/0xe156d0713be97662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243c88 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390371.116728:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf735a00/0xe156d0713be97662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c88 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390371.116769:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf735a00/0xe156d0713be97662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c88 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390371.116794:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735a00, rc 0) 00000100:00100000:3.0:1788390371.116916:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6169:x1875263088498944:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 Request processed in 257us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390371.116922:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 246 00000100:00100000:2.0:1788390371.118227:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390371.118996:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088499072 00000100:00100000:1.0:1788390371.119008:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088499072 00000100:00100000:1.0:1788390371.119064:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 247 00000100:00100000:1.0:1788390371.119074:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6169:x1875263088499072:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390371.119349:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6169:x1875263088499072:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 Request processed in 275us (1130us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390371.119358:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 247 00000100:00100000:2.0:1788390371.409985:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097991680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390371.410067:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390371.410258:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097991680 00000100:00100000:3.0:1788390371.410267:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097991680 00000100:00100000:3.0:1788390371.410364:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390371.410378:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097991680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788390371.410417:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390371.412367:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097991808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390371.412458:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390371.419551:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097992192:0@lo:400:kworker.0 00000100:00100000:2.0:1788390371.419744:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390371.420632:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097991936:0@lo:400:kworker.0 00000100:00100000:1.0:1788390371.420700:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390371.420759:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390371.420767:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263097992064:0@lo:400:kworker.0 00000100:00100000:1.0:1788390371.420796:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390371.420830:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097992064 00000100:00100000:1.0:1788390371.420841:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097992064 00000100:00100000:1.0:1788390371.422061:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390371.422082:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263097992064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390371.422193:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263097992064:12345-0@lo:400:kworker.0 Request processed in 119us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390371.422214:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390371.422277:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263097992064:0@lo:400:kworker.0 00000100:00100000:1.0:1788390371.422310:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097991936 00000100:00100000:1.0:1788390371.422315:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097991936 00000100:00100000:1.0:1788390371.422376:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788390371.422384:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263097991936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390371.422423:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263097991936:12345-0@lo:400:kworker.0 Request processed in 41us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390371.422430:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788390371.422457:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097991936:0@lo:400:kworker.0 00000100:00100000:1.0:1788390371.422540:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097992192 00000100:00100000:1.0:1788390371.422546:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097992192 00000100:00100000:1.0:1788390371.422575:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390371.422581:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097992192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390371.422620:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097992192:12345-0@lo:400:kworker.0 Request processed in 38us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390371.422625:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788390371.422643:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390371.422660:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097991808 00000100:00100000:1.0:1788390371.422665:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097991808 00000100:00100000:1.0:1788390371.422696:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788390371.422702:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097991808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390371.422720:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390371.422785:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097991808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (10327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390371.422793:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788390371.422806:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788390371.423492:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1901c00 x1875263097991808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390371.423518:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097991808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390371.432153:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097991680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 21757us (22062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390371.432173:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390371.434569:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263097992448:0@lo:400:kworker.0 00000100:00100000:0.0:1788390371.434672:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390371.434803:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263097992320:0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.434843:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390371.434889:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097992448 00000100:00100000:3.0:1788390371.434892:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097992320 00000100:00100000:3.0:1788390371.434898:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097992320 00000100:00100000:0.0:1788390371.434904:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097992448 00000100:00100000:1.0:1788390371.435021:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263097992576:0@lo:400:kworker.0 00000100:00100000:1.0:1788390371.435053:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788390371.439272:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fb76e1880 x1875263097991680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390371.439295:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788390371.439348:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097991680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390371.439394:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263097992704:0@lo:400:kworker.0 00000100:00080000:1.0:1788390371.442013:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390371.445355:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097992576 00000100:00100000:3.0:1788390371.445378:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097992576 00000100:00100000:3.0:1788390371.445489:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788390371.445507:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263097992320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.445625:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263097992320:12345-0@lo:400:kworker.0 Request processed in 125us (10781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390371.445633:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788390371.445654:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788390371.445662:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263097992448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.445724:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263097992448:12345-0@lo:400:kworker.0 Request processed in 62us (11053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390371.445739:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788390371.445764:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788390371.445771:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263097992576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.445809:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263097992576:12345-0@lo:400:kworker.0 Request processed in 39us (10755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390371.445815:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788390371.445845:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390371.445887:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263097992832:0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.445939:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390371.445987:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263097992320:0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.446018:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097992832 00000100:00100000:3.0:1788390371.446021:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097992832 00000100:00100000:3.0:1788390371.446045:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788390371.446050:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875263097992832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.446078:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875263097992832:12345-0@lo:400:kworker.0 Request processed in 28us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390371.446083:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788390371.446093:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788390371.446108:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1901880 x1875263097992832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390371.446118:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263097992832:0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.446140:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263097992448:0@lo:400:kworker.0 00010000:00080000:3.0:1788390371.446177:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1901c00 x1875263097992576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390371.446187:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263097992576:0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.446239:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390371.446264:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097992704 00000100:00100000:3.0:1788390371.446268:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097992704 00000100:00100000:3.0:1788390371.446290:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788390371.446296:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263097992704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.446355:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263097992704:12345-0@lo:400:kworker.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390371.446362:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788390371.446375:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390371.446397:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263097992704:0@lo:400:kworker.0 00000100:00100000:3.0:1788390371.446412:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097992192:0@lo:400:kworker.0 00010000:00010000:1.0:1788390371.473805:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390372.497438:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788390372.783911:0:10367:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcad403d0 20000000:00000080:2.0:1788390372.783931:0:10367:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984f98ddac00 uarg=0000000000000000 20000000:01000000:2.0:1788390372.783974:0:10367:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788390372.783980:0:10367:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788390372.783985:0:10367:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788390372.784611:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788390372.784776:0:10367:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788390372.787657:0:10367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788390372.787697:0:10367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788390372.787714:0:10367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788390372.787743:0:10367:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788390372.787763:0:10367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.787780:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5ce000/0xe156d0713be97305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be972fe expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.787787:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9730c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.787794:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97360 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.787800:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97486 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.787810:0:10367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c49 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.787818:0:10367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.787877:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c49 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.787891:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c49 expref: 9 pid: 6487 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390372.787906:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097992960:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390372.788054:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97486 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.788063:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97486 expref: 23 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390372.788071:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097993088:0@lo:104: 00000100:00100000:2.0:1788390372.788110:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390372.788139:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97360 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.788146:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97360 expref: 23 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390372.788154:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097993216:0@lo:104: 00000100:00100000:2.0:1788390372.788175:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390372.788208:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9730c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.788215:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9730c expref: 23 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390372.788234:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097993344:0@lo:104: 00010000:00010000:2.0:1788390372.788258:0:10367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f8a5ce000/0xe156d0713be97305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be972fe expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.788265:0:10367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984f8a5ce000/0xe156d0713be97305 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be972fe expref: 23 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390372.788272:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097993472:0@lo:104: 00000100:00100000:2.0:1788390372.788288:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390372.788379:0:10310:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788390372.788396:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390372.788415:0:10310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390372.788423:0:10310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097993088 00000100:00100000:1.0:1788390372.788429:0:10310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097993088 00000100:00100000:2.0:1788390372.788501:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097993216 00000100:00100000:2.0:1788390372.788504:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097993216 00000100:00100000:3.0:1788390372.788690:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097993344 00000100:00100000:3.0:1788390372.788695:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097993344 00000100:00100000:1.0:1788390372.788745:0:10310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097993472 00000100:00100000:1.0:1788390372.788749:0:10310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097993472 00000100:00100000:2.0:1788390372.788785:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788390372.788797:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+6:10367:x1875263097993088:12345-0@lo:104: 00010000:00010000:2.0:1788390372.788811:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.788875:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390372.788881:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+6:10367:x1875263097993088:12345-0@lo:104: Request processed in 87us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390372.788888:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788390372.788908:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788390372.788914:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+5:10367:x1875263097993216:12345-0@lo:104: 00010000:00010000:2.0:1788390372.788921:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.788954:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788390372.788959:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+5:10367:x1875263097993216:12345-0@lo:104: Request processed in 46us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390372.788973:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788390372.789018:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390372.789024:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789031:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734e00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390372.789035:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789043:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390372.789050:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390372.789055:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788390372.789083:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789089:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390372.789107:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789113:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf734e00/0xe156d0713be97486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9748d expref: -99 pid: 9483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789130:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390372.789133:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789148:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce600 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390372.789150:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789157:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390372.789162:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390372.789167:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788390372.789182:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789187:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390372.789193:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789198:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce600/0xe156d0713be97360 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97367 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.789208:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390372.789209:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390372.789211:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390372.789237:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097993600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390372.789265:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390372.789290:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390372.789296:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097993728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390372.789351:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390372.790285:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097993600 00000100:00100000:0.0:1788390372.790294:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097993600 00010000:00010000:0.0:1788390372.790347:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97486 expref: 24 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390372.790386:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097993728 00000100:00100000:0.0:1788390372.790390:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097993728 00010000:00010000:0.0:1788390372.790402:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97360 expref: 25 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390372.790415:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788390372.790422:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+25:3624:x1875263097993600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390372.790433:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390372.790438:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97486 expref: 25 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.790447:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97486 expref: 25 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.790463:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390372.790502:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+25:3624:x1875263097993600:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390372.790509:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788390372.790530:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788390372.790537:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263097993728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390372.790544:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390372.790548:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97360 expref: 24 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.790556:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97360 expref: 24 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.790565:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390372.790596:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263097993728:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390372.790602:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788390372.790845:0:10367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cea00/0xe156d0713be9748d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97486 expref: 23 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390372.790856:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097993088:0@lo:104: 00010000:00010000:0.0:1788390372.790866:0:10367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cfc00/0xe156d0713be97367 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97360 expref: 22 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390372.790873:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097993216:0@lo:104: 00000100:00100000:2.0:1788390372.790945:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097993728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390372.790952:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263097993600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390372.791233:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788390372.791243:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:10367:x1875263097993344:12345-0@lo:104: 00010000:00010000:3.0:1788390372.791254:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.791310:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390372.791316:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:10367:x1875263097993344:12345-0@lo:104: Request processed in 76us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390372.791343:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788390372.791579:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097993344:0@lo:104: 00000100:00100000:0.0:1788390372.791647:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788390372.791656:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:10367:x1875263097993472:12345-0@lo:104: 00010000:00010000:0.0:1788390372.791665:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.791707:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788390372.791712:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+3:10367:x1875263097993472:12345-0@lo:104: Request processed in 59us (3297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390372.791728:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788390372.791779:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097993472:0@lo:104: 00010000:00010000:3.0:1788390372.791808:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390372.791819:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.791825:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80031800 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390372.791829:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.791836:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390372.791842:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390372.791846:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390372.791866:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.791871:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788390372.791910:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097993856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390372.791942:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390372.791993:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.792000:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f80031800/0xe156d0713be9730c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97313 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.792009:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390372.792012:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.792017:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cf000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390372.792019:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.792033:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390372.792039:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390372.792044:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390372.792057:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.792074:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788390372.792110:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097993856 00000100:00100000:0.0:1788390372.792115:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097993856 00010000:00010000:0.0:1788390372.792133:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9730c expref: 22 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390372.792153:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390372.792159:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:3622:x1875263097993856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390372.792167:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390372.792178:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9730c expref: 22 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.792186:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9730c expref: 22 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.792197:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80030600/0xe156d0713be97313 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9730c expref: 22 pid: 6487 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.792207:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390372.792676:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.792685:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be972fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97305 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.792699:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390372.792701:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390372.792702:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390372.792715:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097993984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390372.792761:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390372.792891:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390372.792909:0:6479:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788390372.792918:0:6479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788390372.793087:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3622:x1875263097993856:12345-0@lo:103:ldlm_bl.0 Request processed in 926us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390372.793095:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390372.793115:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097993984 00000100:00100000:0.0:1788390372.793130:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097993984 00010000:00010000:0.0:1788390372.793147:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f8a5ce000/0xe156d0713be97305 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972fe expref: 21 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390372.793162:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390372.793169:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3623:x1875263097993984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390372.793177:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390372.793181:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f8a5ce000/0xe156d0713be97305 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be972fe expref: 21 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.793188:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f8a5ce000/0xe156d0713be97305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be972fe expref: 21 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.793199:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5ce000/0xe156d0713be97305 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be972fe expref: 21 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390372.793208:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390372.793250:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:3623:x1875263097993984:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390372.793256:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788390372.793525:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263097993984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390372.794030:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390372.794221:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097993856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390372.794255:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10367:1875263097992960:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390372.794288:0:10367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390372.794508:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088499200 00000100:00100000:3.0:1788390372.794514:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088499200 00010000:00010000:3.0:1788390372.794537:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c49 expref: 10 pid: 6487 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390372.794591:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:3.0:1788390372.794608:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2404:x1875263088499200:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390372.794620:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390372.794625:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c49 expref: 10 pid: 6487 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794634:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c49 expref: 10 pid: 6487 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794646:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be975a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c49 expref: 10 pid: 6487 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794659:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794668:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794681:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794687:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794693:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794698:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794704:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390372.794708:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794731:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794747:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390372.794755:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390372.794837:0:10367:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.794844:0:10367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390372.794849:0:10367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b4800/0xe156d0713be97669 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390372.796368:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+9:2404:x1875263088499200:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 1755us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390372.796380:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:3.0:1788390373.012463:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390373.012598:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088499328 00000100:00100000:1.0:1788390373.012615:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088499328 00000100:00100000:1.0:1788390373.012696:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 249 00000100:00100000:1.0:1788390373.012726:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+9:6169:x1875263088499328:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390373.012748:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390373.012777:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243c8f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390373.012838:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c8f expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390373.012851:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c8f expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390373.012862:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5c00, rc 0) 00000100:00100000:1.0:1788390373.012932:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6169:x1875263088499328:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 Request processed in 227us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390373.012940:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 249 00000100:00100000:1.0:1788390373.016451:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390373.016577:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088499456 00000100:00100000:0.0:1788390373.016591:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088499456 00000100:00100000:0.0:1788390373.016725:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 250 00000100:00100000:0.0:1788390373.016740:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6169:x1875263088499456:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390373.016944:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6169:x1875263088499456:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 Request processed in 207us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390373.016954:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 250 00000100:00100000:0.0:1788390373.021666:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390373.021823:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088499584 00000100:00100000:3.0:1788390373.021833:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088499584 00000100:00100000:3.0:1788390373.021949:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 251 00000100:00100000:3.0:1788390373.021961:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6169:x1875263088499584:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390373.022123:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6169:x1875263088499584:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 Request processed in 163us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390373.022130:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 251 00000100:00100000:3.0:1788390373.024939:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390373.025046:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088499712 00000100:00100000:0.0:1788390373.025060:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088499712 00000100:00100000:0.0:1788390373.025130:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 252 00000100:00100000:0.0:1788390373.025141:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6724:x1875263088499712:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390373.025302:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6724:x1875263088499712:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 163us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390373.025308:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 252 00000100:00100000:0.0:1788390373.031065:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390373.031215:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088499840 00000100:00100000:3.0:1788390373.031227:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088499840 00000100:00100000:3.0:1788390373.031369:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 253 00000100:00100000:3.0:1788390373.031381:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6724:x1875263088499840:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390373.031658:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:6724:x1875263088499840:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 279us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390373.031667:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 253 00010000:00010000:1.0:1788390373.522574:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390373.969682:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097994112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390373.969771:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390373.969885:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097994112 00000100:00100000:0.0:1788390373.969893:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097994112 00000100:00100000:0.0:1788390373.969948:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788390373.969962:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097994112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788390373.970003:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788390373.970055:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097994112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390373.970075:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788390373.970126:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097994112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788390374.171429:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390374.171463:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390374.171488:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088500224 00000100:00100000:0.0:1788390374.171498:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088500224 00000100:00100000:0.0:1788390374.171559:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00100000:0.0:1788390374.171569:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088500224:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390374.171641:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088500224:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.171649:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00080000:0.0:1788390374.171673:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390374.171702:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390374.171818:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390374.171841:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390374.171859:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088500480 00000100:00100000:0.0:1788390374.171863:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088500480 00000100:00100000:0.0:1788390374.171890:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088500352 00000100:00100000:0.0:1788390374.171893:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088500352 00000100:00100000:0.0:1788390374.171912:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:0.0:1788390374.171919:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088500480:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390374.171952:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088500480:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 34us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.171958:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:0.0:1788390374.171970:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:0.0:1788390374.171976:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088500352:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390374.172009:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088500352:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 34us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.172015:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:0.0:1788390374.172033:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088500096 00000100:00100000:0.0:1788390374.172036:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088500096 00000100:00100000:0.0:1788390374.172058:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:0.0:1788390374.172064:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088500096:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390374.172087:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088500096:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 24us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.172093:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00080000:0.0:1788390374.172108:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390374.172111:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390374.172113:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1788390374.172346:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390374.172355:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fc18b3800 from 4 10000000:01000000:2.0:1788390374.172359:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390374.172397:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390374.172408:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390374.172419:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390374.172441:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097994240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390374.172482:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390374.172522:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.172828:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088499968 00000100:00100000:0.0:1788390374.172832:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088499968 00000100:00100000:0.0:1788390374.172864:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097994240 00000100:00100000:0.0:1788390374.172868:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097994240 00000100:00100000:0.0:1788390374.172882:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 254 00000100:00100000:0.0:1788390374.172888:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2405:x1875263088499968:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390374.172922:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2405:x1875263088499968:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 34us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.172930:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 254 00000100:00100000:0.0:1788390374.172951:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788390374.172957:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263097994240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390374.172966:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390374.172979:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97677 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.173011:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97677 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.173023:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97677 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.173033:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63c200, rc 0) 00000100:00100000:0.0:1788390374.173062:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097994240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.173067:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788390374.173290:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097994240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390374.173304:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390374.173313:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390374.173409:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097994368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390374.173437:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390374.173453:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.176788:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097994368 00000100:00100000:0.0:1788390374.176804:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097994368 00000100:00100000:0.0:1788390374.176867:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788390374.176877:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097994368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.177046:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097994368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (3608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.177053:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788390374.177202:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097994368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390374.177253:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097994496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390374.177300:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390374.177358:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.177449:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097994496 00000100:00100000:0.0:1788390374.177453:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097994496 00000100:00100000:0.0:1788390374.177478:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788390374.177485:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097994496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.177558:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097994496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.177565:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788390374.177640:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097994496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390374.177995:0:10476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10476:1875263097994624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390374.178032:0:10476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390374.178054:0:10476:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.178095:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097994624 00000100:00100000:0.0:1788390374.178099:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097994624 00000100:00100000:0.0:1788390374.178137:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788390374.178145:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10476:x1875263097994624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.178219:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10476:x1875263097994624:12345-0@lo:502:llog_process_th.0 Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.178226:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788390374.178261:0:10476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10476:1875263097994624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390374.178281:0:10476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390374.178289:0:10476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390374.178291:0:10476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788390374.178298:0:10476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fc18b3800 00000020:00000080:0.0:1788390374.178301:0:10476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788390374.178388:0:10476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10476:1875263097994752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.178425:0:10476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.178441:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097994752 00000100:00100000:0.0:1788390374.178444:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097994752 00000100:00100000:0.0:1788390374.178462:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788390374.178468:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10476:x1875263097994752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.178527:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:10476:x1875263097994752:12345-0@lo:502:llog_process_th.0 Request processed in 58us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.178534:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788390374.178563:0:10476:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.178575:0:10476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10476:1875263097994752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390374.178593:0:10476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390374.178597:0:10476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390374.178599:0:10476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788390374.178603:0:10476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788390374.178697:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788390374.178734:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390374.178744:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.178755:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390374.178765:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390374.178767:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fb7b73800 from 4 10000000:01000000:0.0:1788390374.178770:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390374.178793:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.178801:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.178809:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390374.178821:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097994880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.178846:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.178863:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097994880 00000100:00100000:0.0:1788390374.178867:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097994880 00000100:00100000:0.0:1788390374.178884:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788390374.178890:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263097994880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390374.178898:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390374.178909:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97685 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.178929:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97685 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.178946:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97685 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.178954:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63dc00, rc 0) 00000100:00100000:0.0:1788390374.178978:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097994880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.178984:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788390374.179006:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.179017:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097994880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390374.179029:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.179038:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390374.179079:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.179103:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.179120:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097995008 00000100:00100000:0.0:1788390374.179124:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097995008 00000100:00100000:0.0:1788390374.179137:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788390374.179143:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097995008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.179208:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097995008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.179213:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788390374.179232:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.179242:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.179272:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.179306:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.179341:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097995136 00000100:00100000:0.0:1788390374.179344:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097995136 00000100:00100000:0.0:1788390374.179361:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788390374.179367:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097995136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.179425:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097995136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.179431:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788390374.179458:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.179469:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.179589:0:10477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10477:1875263097995264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.179627:0:10477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.179645:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097995264 00000100:00100000:0.0:1788390374.179648:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097995264 00000100:00100000:0.0:1788390374.179664:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788390374.179670:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:10477:x1875263097995264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.179741:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:10477:x1875263097995264:12345-0@lo:502:llog_process_th.0 Request processed in 70us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.179747:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788390374.179774:0:10477:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.179786:0:10477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10477:1875263097995264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390374.179803:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390374.179808:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390374.179815:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788390374.179821:0:10477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fb7b73800 00000020:00000080:0.0:1788390374.179823:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788390374.179864:0:10477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10477:1875263097995392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.179896:0:10477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.179913:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097995392 00000100:00100000:0.0:1788390374.179917:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097995392 00000100:00100000:0.0:1788390374.179933:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788390374.179939:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:10477:x1875263097995392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.179994:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:10477:x1875263097995392:12345-0@lo:502:llog_process_th.0 Request processed in 54us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.180000:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788390374.180025:0:10477:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.180036:0:10477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10477:1875263097995392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390374.180052:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390374.180056:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390374.180058:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788390374.180061:0:10477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788390374.180092:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788390374.180104:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390374.180109:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.180117:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390374.180125:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390374.180127:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fb76a1000 from 4 10000000:01000000:0.0:1788390374.180129:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390374.180148:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.180155:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.180161:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390374.180173:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.180198:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.180209:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.180220:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097995520 00000100:00100000:0.0:1788390374.180222:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097995520 00000100:00100000:0.0:1788390374.180239:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788390374.180244:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263097995520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390374.180250:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390374.180258:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97693 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.180272:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97693 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.180281:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97693 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.180287:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63c400, rc 0) 00000100:00100000:0.0:1788390374.180315:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097995520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.180341:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788390374.180376:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390374.180386:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.180394:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390374.180427:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.180462:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.180475:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.180485:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097995648 00000100:00100000:0.0:1788390374.180488:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097995648 00000100:00100000:0.0:1788390374.180505:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788390374.180510:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097995648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.180570:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097995648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.180577:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788390374.180620:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.180641:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.180671:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.180683:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.180694:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097995776 00000100:00100000:0.0:1788390374.180697:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097995776 00000100:00100000:0.0:1788390374.180727:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788390374.180733:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097995776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.180794:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097995776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.180806:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788390374.180840:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097995776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390374.186578:0:10478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10478:1875263097995904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390374.186664:0:10478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390374.186699:0:10478:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.186772:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097995904 00000100:00100000:0.0:1788390374.186780:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097995904 00000100:00100000:0.0:1788390374.186830:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788390374.186840:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10478:x1875263097995904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.186953:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10478:x1875263097995904:12345-0@lo:502:llog_process_th.0 Request processed in 114us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.186962:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788390374.187059:0:10478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10478:1875263097995904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788390374.187110:0:10478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390374.187120:0:10478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390374.187122:0:10478:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788390374.187129:0:10478:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fb76a1000 00000020:00000080:3.0:1788390374.187132:0:10478:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788390374.191949:0:10478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10478:1875263097996032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390374.192029:0:10478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390374.192064:0:10478:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390374.196923:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097996032 00000100:00100000:1.0:1788390374.196937:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097996032 00000100:00100000:1.0:1788390374.196991:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788390374.197001:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10478:x1875263097996032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390374.197165:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+23:10478:x1875263097996032:12345-0@lo:502:llog_process_th.0 Request processed in 165us (5136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390374.197174:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788390374.212408:0:10478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10478:1875263097996032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788390374.212451:0:10478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390374.212458:0:10478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390374.212460:0:10478:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788390374.212463:0:10478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788390374.216386:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788390374.216423:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390374.216434:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.216446:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390374.216456:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390374.216459:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984f988e6800 from 4 10000000:01000000:0.0:1788390374.216462:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390374.216498:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.216506:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.216518:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390374.216554:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097996160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.216615:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.216653:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.216673:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097996160 00000100:00100000:0.0:1788390374.216680:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097996160 00000100:00100000:0.0:1788390374.216737:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788390374.216746:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263097996160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390374.216758:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390374.216782:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be976a1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.216806:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be976a1 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.216816:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be976a1 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.216826:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81c00, rc 0) 00000100:00100000:0.0:1788390374.216862:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097996160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.216869:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788390374.216917:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097996160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390374.216930:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.216939:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390374.216994:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097996288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.217019:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.217034:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.217046:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097996288 00000100:00100000:0.0:1788390374.217050:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097996288 00000100:00100000:0.0:1788390374.217072:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788390374.217078:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097996288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.217175:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097996288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.217182:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788390374.217208:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097996288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.217229:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097996416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.217274:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.217287:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.217298:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097996416 00000100:00100000:0.0:1788390374.217301:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097996416 00000100:00100000:0.0:1788390374.217341:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788390374.217348:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097996416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.217418:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263097996416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.217424:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788390374.217460:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263097996416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390374.226561:0:10482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10482:1875263097996544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.226654:0:10482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.226691:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097996544 00000100:00100000:0.0:1788390374.226698:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097996544 00000100:00100000:0.0:1788390374.226749:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788390374.226758:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:10482:x1875263097996544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.226864:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:10482:x1875263097996544:12345-0@lo:502:llog_process_th.0 Request processed in 107us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.226872:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788390374.226927:0:10482:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.226948:0:10482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10482:1875263097996544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390374.226975:0:10482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390374.226984:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390374.226987:0:10482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788390374.226994:0:10482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984f988e6800 00000020:00000080:0.0:1788390374.226996:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788390374.227058:0:10482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10482:1875263097996672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.227090:0:10482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390374.227110:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097996672 00000100:00100000:0.0:1788390374.227114:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097996672 00000100:00100000:0.0:1788390374.227135:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788390374.227141:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:10482:x1875263097996672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390374.227201:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:10482:x1875263097996672:12345-0@lo:502:llog_process_th.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390374.227207:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788390374.227235:0:10482:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390374.227247:0:10482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:10482:1875263097996672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390374.227271:0:10482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390374.227275:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390374.227276:0:10482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788390374.227280:0:10482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788390374.227353:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788390374.227370:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390374.227378:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390374.227388:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390374.545505:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390375.570747:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390376.018346:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097996800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390376.018419:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.021030:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097996928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390376.021092:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.021149:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097997056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390376.021160:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097996800 00000100:00100000:1.0:1788390376.021168:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097996800 00000100:00100000:3.0:1788390376.021176:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390376.021218:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097996928 00000100:00100000:3.0:1788390376.021222:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390376.021222:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097996928 00000100:00100000:1.0:1788390376.021241:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390376.021249:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097996928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390376.021287:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390376.021302:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097996800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390376.021312:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390376.021346:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097996928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390376.021353:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390376.021371:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097996800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390376.021377:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390376.021379:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097997056 00000100:00100000:1.0:1788390376.021382:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097997056 00000100:00100000:1.0:1788390376.021407:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788390376.021414:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097997056:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788390376.021415:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb153b80 x1875263097996800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390376.021434:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097996800:0@lo:13:osp-pre-0-1.0 00000004:00000024:1.0:1788390376.021434:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788390376.021471:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263097997056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390376.021477:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788390376.021484:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263097997056:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788390376.021492:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788390376.021526:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb21b480 x1875263097996928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390376.021538:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097996928:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788390376.318301:0:10667:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788390376.533127:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097997184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390376.533210:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.533265:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390376.533271:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097997312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390376.533485:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097997440:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.533509:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.533534:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097997696:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.533559:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.533578:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263097998208:0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.533579:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.533599:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390376.533602:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097997952:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.533613:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263097998720:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.533629:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390376.533629:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.533645:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788390376.533646:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097998464:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.533649:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263097997824:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.533666:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390376.533666:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.533680:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097998336:0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.533681:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788390376.533700:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097997568:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.533714:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390376.533717:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.533737:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097998848:0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.533737:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263097998080:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.533754:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390376.533920:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390376.533942:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097997184 00000100:00100000:3.0:1788390376.533949:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097997184 00000100:00100000:3.0:1788390376.534045:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097997312 00000100:00100000:3.0:1788390376.534049:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097997312 00000100:00080000:0.0:1788390376.534073:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390376.534086:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263097998592:0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.534110:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390376.534133:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097997440 00000100:00100000:1.0:1788390376.534136:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097997440 00000100:00100000:3.0:1788390376.534161:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788390376.534169:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097997184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788390376.534206:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390376.534246:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097997184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390376.534250:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097998208 00000100:00100000:3.0:1788390376.534253:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390376.534254:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097998208 00000100:00100000:3.0:1788390376.534268:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390376.534275:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097997312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390376.534304:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788390376.534311:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263097997440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.534446:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263097997440:12345-0@lo:400:kworker.0 Request processed in 134us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390376.534460:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788390376.534491:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097997696 00002000:00000024:3.0:1788390376.534494:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390376.534495:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097997696 00000100:00100000:3.0:1788390376.534520:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097997312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 246us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390376.534526:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788390376.534527:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097997952 00000100:00100000:1.0:1788390376.534530:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097997952 00000100:00100000:3.0:1788390376.534541:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097998720 00000100:00100000:1.0:1788390376.534541:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788390376.534544:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097998720 00000100:00100000:1.0:1788390376.534547:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097997696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.534584:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097997696:12345-0@lo:400:kworker.0 Request processed in 36us (1024us total) trans 0 rc 0/0 00000100:00080000:0.0:1788390376.534588:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390376.534590:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788390376.534602:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788390376.534608:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097997952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.534637:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097997952:12345-0@lo:400:kworker.0 Request processed in 26us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390376.534642:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788390376.534659:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097998464 00000100:00100000:1.0:1788390376.534664:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097998464 00000100:00100000:1.0:1788390376.534709:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097998336 00000100:00100000:1.0:1788390376.534712:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097998336 00000100:00100000:1.0:1788390376.534723:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097998848 00000100:00100000:1.0:1788390376.534726:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097998848 00000100:00100000:1.0:1788390376.534736:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390376.534741:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390376.534742:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097998464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390376.534747:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097998336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.534780:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097998464:12345-0@lo:400:kworker.0 Request processed in 38us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390376.534780:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097998336:12345-0@lo:400:kworker.0 Request processed in 33us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390376.534787:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390376.534816:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390376.534830:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390376.534836:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097998848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390376.534874:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263097998848:12345-0@lo:400:kworker.0 Request processed in 38us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390376.534880:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390376.535141:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097997824 00000100:00100000:1.0:1788390376.535146:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097997824 00000100:00100000:1.0:1788390376.535168:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097997568 00000100:00100000:1.0:1788390376.535171:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097997568 00000100:00100000:1.0:1788390376.535183:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097998080 00000100:00100000:1.0:1788390376.535185:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097998080 00000100:00100000:1.0:1788390376.535209:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097998592 00000100:00100000:1.0:1788390376.535212:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097998592 00000100:00100000:1.0:1788390376.535226:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788390376.535233:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263097997824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.535263:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263097997824:12345-0@lo:400:kworker.0 Request processed in 31us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390376.535269:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788390376.535281:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788390376.535287:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097997568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.535313:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097997568:12345-0@lo:400:kworker.0 Request processed in 26us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390376.535338:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788390376.535413:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788390376.535419:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263097998080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.535456:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263097998080:12345-0@lo:400:kworker.0 Request processed in 37us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390376.535462:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788390376.535475:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788390376.535481:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263097998592:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788390376.535537:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390376.535568:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263097998592:12345-0@lo:400:kworker.0 Request processed in 87us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390376.535575:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788390376.535621:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097997568:0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.535632:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263097998080:0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.535641:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263097998592:0@lo:400:kworker.0 00000100:00100000:2.0:1788390376.535711:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788390376.535719:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263097998208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.535745:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788390376.535752:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263097998720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.535866:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097997440:0@lo:400:kworker.0 00000100:00100000:1.0:1788390376.535878:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097997952:0@lo:400:kworker.0 00010000:00080000:1.0:1788390376.535891:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1901880 x1875263097998464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390376.535901:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097998464:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.536062:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263097998720:12345-0@lo:400:kworker.0 Request processed in 309us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390376.536062:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263097998208:12345-0@lo:400:kworker.0 Request processed in 343us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390376.536069:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788390376.536111:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263097997824:0@lo:400:kworker.0 00010000:00080000:3.0:1788390376.536124:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1901c00 x1875263097998336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390376.536139:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097998336:0@lo:400:kworker.0 00010000:00080000:3.0:1788390376.536151:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877c9500 x1875263097998848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390376.536160:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097998848:0@lo:400:kworker.0 00000100:00100000:3.0:1788390376.536170:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097997696:0@lo:400:kworker.0 00000100:00100000:2.0:1788390376.536172:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788390376.536734:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1901500 x1875263097998208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390376.536853:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263097998208:0@lo:400:kworker.0 00010000:00080000:3.0:1788390376.536871:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1903480 x1875263097998720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390376.536880:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263097998720:0@lo:400:kworker.0 00010000:00080000:3.0:1788390376.536891:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb21b480 x1875263097997312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390376.536906:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263097997312:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788390376.536917:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8794ad80 x1875263097997184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390376.537078:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097997184:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788390376.594115:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390377.617719:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390378.641464:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390379.097718:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097998976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390379.097788:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390379.097874:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097998976 00000100:00100000:1.0:1788390379.097882:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097998976 00000100:00100000:1.0:1788390379.097940:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788390379.097950:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097998976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788390379.097992:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788390379.098041:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263097998976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390379.098048:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788390379.098102:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263097998976:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788390379.134468:0:10911:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing yml_node 00000100:00100000:0.0:1788390379.291106:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390379.291188:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390379.291232:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390379.291253:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390379.291277:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390379.291305:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088501120 00000100:00100000:0.0:1788390379.291316:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088501120 00000100:00100000:0.0:1788390379.291398:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088500992 00000100:00100000:0.0:1788390379.291402:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088500992 00000100:00100000:0.0:1788390379.291427:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:0.0:1788390379.291437:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088501120:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390379.291506:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088501120:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390379.291514:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:0.0:1788390379.291535:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:0.0:1788390379.291542:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088500992:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390379.291568:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088500992:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 27us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390379.291575:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:0.0:1788390379.291594:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088500864 00000100:00100000:0.0:1788390379.291598:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088500864 00000100:00100000:0.0:1788390379.291624:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088500736 00000100:00100000:0.0:1788390379.291627:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088500736 00000100:00100000:0.0:1788390379.291649:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 75 00000100:00100000:0.0:1788390379.291656:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088500864:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390379.291695:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088500864:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 39us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390379.291701:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 75 00000100:00100000:0.0:1788390379.291723:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 76 00000100:00100000:0.0:1788390379.291729:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088500736:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390379.291755:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088500736:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390379.291760:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 76 00000100:00080000:0.0:1788390379.291781:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390379.291786:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788390379.291788:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390379.291790:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390379.292827:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088500608 00000100:00100000:1.0:1788390379.292836:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088500608 00000100:00100000:1.0:1788390379.292916:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 276 00000100:00100000:1.0:1788390379.292925:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2404:x1875263088500608:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390379.292980:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2404:x1875263088500608:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 56us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390379.292988:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 276 00010000:00010000:0.0:1788390379.665946:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390380.692296:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390381.140966:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390381.140989:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097999104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390381.141055:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390381.141129:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097999104 00000100:00100000:3.0:1788390381.141150:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097999104 00000100:00100000:3.0:1788390381.141207:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390381.141218:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097999104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390381.141248:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390381.141290:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263097999104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390381.141297:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788390381.141350:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87af4e00 x1875263097999104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390381.141367:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263097999104:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390381.141481:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390381.141489:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390381.141499:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097999232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390381.141526:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390381.141669:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097999232 00000100:00100000:2.0:1788390381.141674:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097999232 00000100:00100000:2.0:1788390381.141716:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788390381.141722:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097999232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788390381.141733:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390381.141763:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263097999232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390381.141769:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788390381.141828:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788390381.141847:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b2df80 x1875263097999232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390381.141860:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263097999232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390381.142003:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097999360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788390381.142031:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390381.142104:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097999360 00000100:00100000:2.0:1788390381.142108:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097999360 00000100:00100000:2.0:1788390381.142140:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788390381.142147:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097999360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788390381.142169:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788390381.142207:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263097999360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390381.142223:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788390381.142284:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263097999360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390381.650316:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097999488:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650397:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.650446:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098000000:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650469:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.650487:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098000512:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650506:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.650528:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098001024:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650545:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.650571:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788390381.650577:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097999616:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650612:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.650631:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098000128:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650661:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.650678:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098000640:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650699:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.650730:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097999744:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650754:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390381.650756:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097999616 00000100:00100000:2.0:1788390381.650765:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097999616 00000100:00100000:1.0:1788390381.650779:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098000256:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650803:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390381.650814:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098000128 00000100:00100000:1.0:1788390381.650817:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098000768:0@lo:400:kworker.0 00000100:00100000:2.0:1788390381.650819:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098000128 00000100:00100000:1.0:1788390381.650843:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390381.650853:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098000640 00000100:00100000:2.0:1788390381.650857:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098000640 00000100:00100000:1.0:1788390381.650860:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788390381.650868:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263097999872:0@lo:400:kworker.0 00000100:00100000:2.0:1788390381.650874:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098000256 00000100:00100000:2.0:1788390381.650878:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098000256 00000100:00100000:1.0:1788390381.650895:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390381.650897:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098000768 00000100:00100000:2.0:1788390381.650901:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098000768 00000100:00100000:1.0:1788390381.650910:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098000384:0@lo:400:kworker.0 00000100:00100000:2.0:1788390381.650918:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097999872 00000100:00100000:2.0:1788390381.650923:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097999872 00000100:00100000:2.0:1788390381.650942:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788390381.650948:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390381.650957:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097999616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650971:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098000896:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.650999:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.651233:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097999488 00000100:00100000:1.0:1788390381.651238:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097999488 00000100:00100000:1.0:1788390381.651271:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788390381.651278:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263097999488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.651312:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263097999488:12345-0@lo:400:kworker.0 Request processed in 34us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.651349:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788390381.651384:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098000000 00000100:00100000:1.0:1788390381.651388:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098000000 00000100:00100000:1.0:1788390381.651408:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263097999744 00000100:00100000:1.0:1788390381.651411:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263097999744 00000100:00100000:1.0:1788390381.651485:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788390381.651492:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098000000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.651524:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098000000:12345-0@lo:400:kworker.0 Request processed in 33us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.651530:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788390381.651541:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788390381.651547:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097999744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.651580:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263097999744:12345-0@lo:400:kworker.0 Request processed in 33us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.651586:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788390381.651622:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263097999744:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.651701:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098000512 00000100:00100000:1.0:1788390381.651705:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098000512 00000100:00100000:1.0:1788390381.651723:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098001024 00000100:00100000:1.0:1788390381.651726:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098001024 00000100:00100000:1.0:1788390381.651738:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098000384 00000100:00100000:1.0:1788390381.651740:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098000384 00000100:00100000:1.0:1788390381.651750:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098000896 00000100:00100000:1.0:1788390381.651753:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098000896 00000100:00100000:1.0:1788390381.651768:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390381.651774:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098000512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.651804:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098000512:12345-0@lo:400:kworker.0 Request processed in 30us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.651816:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390381.651828:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390381.651834:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098001024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.651860:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098001024:12345-0@lo:400:kworker.0 Request processed in 27us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.651866:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390381.651878:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390381.651884:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098000384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.651913:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098000384:12345-0@lo:400:kworker.0 Request processed in 30us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.651919:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390381.651933:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390381.651939:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098000896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.651976:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098000896:12345-0@lo:400:kworker.0 Request processed in 37us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.651981:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390381.652002:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788390381.652010:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098000128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.652039:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098000128:12345-0@lo:400:kworker.0 Request processed in 31us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.652046:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788390381.652259:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788390381.652266:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098000640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.652298:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098000640:12345-0@lo:400:kworker.0 Request processed in 33us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.652310:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788390381.652347:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788390381.652354:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098000256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.652383:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098000256:12345-0@lo:400:kworker.0 Request processed in 30us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.652388:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788390381.652400:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788390381.652406:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098000768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.652523:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098000768:12345-0@lo:400:kworker.0 Request processed in 116us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.652529:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788390381.652543:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788390381.652550:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263097999872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.652578:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263097999872:12345-0@lo:400:kworker.0 Request processed in 30us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.652584:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788390381.652610:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390381.652617:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788390381.652620:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390381.652627:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263097999872:0@lo:400:kworker.0 00010000:00080000:1.0:1788390381.652680:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e879b7800 x1875263098000384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390381.652691:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098000384:0@lo:400:kworker.0 00010000:00080000:1.0:1788390381.652701:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e879b4a80 x1875263098000896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390381.652709:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098000896:0@lo:400:kworker.0 00010000:00080000:1.0:1788390381.652725:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e879b6300 x1875263098000256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390381.652733:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098000256:0@lo:400:kworker.0 00010000:00080000:1.0:1788390381.652742:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e879b4000 x1875263098000768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390381.652749:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098000768:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.652810:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390381.652820:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098001280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390381.652847:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.652878:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098001280 00000100:00100000:1.0:1788390381.652881:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098001280 00000100:00100000:1.0:1788390381.652909:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788390381.652915:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098001280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788390381.652935:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390381.652967:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098001280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.652973:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788390381.652996:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88069500 x1875263098001280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390381.653010:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098001280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390381.653164:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263097999616:12345-0@lo:400:kworker.0 Request processed in 2209us (2550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390381.653172:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788390381.653347:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098001152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390381.653378:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390381.653414:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098001152 00000100:00100000:1.0:1788390381.653488:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098001152 00000100:00100000:1.0:1788390381.653522:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788390381.653530:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098001152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390381.653550:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390381.653584:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098001152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390381.653590:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390381.656135:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263097999616:0@lo:400:kworker.0 00010000:00080000:2.0:1788390381.656269:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87af4e00 x1875263098001152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390381.656290:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098001152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390381.657054:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098000128:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.657068:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098000640:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.657080:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263097999488:0@lo:400:kworker.0 00000100:00100000:1.0:1788390381.657091:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098000000:0@lo:400:kworker.0 00010000:00080000:1.0:1788390381.657104:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e879b6680 x1875263098000512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390381.657115:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098000512:0@lo:400:kworker.0 00010000:00080000:1.0:1788390381.657126:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1903480 x1875263098001024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390381.657135:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098001024:0@lo:400:kworker.0 00010000:00010000:1.0:1788390381.716675:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390382.054749:0:11094:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:1.0:1788390382.739518:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390383.623803:0:11191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:2.0:1788390383.762987:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390384.216383:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098001408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390384.216458:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390384.222704:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098001408 00000100:00100000:0.0:1788390384.222720:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098001408 00000100:00100000:0.0:1788390384.222786:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788390384.222798:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098001408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788390384.222835:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788390384.222923:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098001408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (6465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390384.222931:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788390384.225115:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098001408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788390384.407915:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390384.407956:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390384.407978:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390384.408027:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088501504 00000100:00100000:0.0:1788390384.408036:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088501504 00000100:00100000:0.0:1788390384.408079:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088501376 00000100:00100000:0.0:1788390384.408081:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088501376 00000100:00100000:0.0:1788390384.408093:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 83 00000100:00100000:0.0:1788390384.408100:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088501504:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390384.408169:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088501504:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 68us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390384.408174:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 83 00000100:00100000:0.0:1788390384.408193:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 84 00000100:00100000:0.0:1788390384.408197:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2407:x1875263088501376:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390384.408214:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2407:x1875263088501376:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 17us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390384.408218:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 84 00000100:00100000:2.0:1788390384.408397:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088501248 00000100:00100000:2.0:1788390384.408401:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088501248 00000100:00100000:2.0:1788390384.408431:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 278 00000100:00100000:2.0:1788390384.408453:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2407:x1875263088501248:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390384.408487:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2407:x1875263088501248:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 36us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390384.408493:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 278 00000100:00080000:3.0:1788390384.408724:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390384.408729:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390384.408790:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390384.408829:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390384.408892:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088501632 00000100:00100000:2.0:1788390384.408896:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088501632 00000100:00100000:2.0:1788390384.408931:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088501760 00000100:00100000:2.0:1788390384.408933:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088501760 00000100:00100000:2.0:1788390384.408950:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:2.0:1788390384.408956:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2403:x1875263088501632:12345-192.168.202.11@tcp:9:kworker.0 00000100:00100000:3.0:1788390384.408961:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:3.0:1788390384.408975:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2403:x1875263088501760:12345-192.168.202.11@tcp:9:kworker.0 00000020:00000080:2.0:1788390384.408980:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be975ba 00000100:00080000:2.0:1788390384.408991:0:8407:0:(import.c:65:import_set_state_nolock()) ffff984fc19aa800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788390384.408999:0:8798:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be975c1 00000100:00080000:3.0:1788390384.409009:0:8798:0:(import.c:65:import_set_state_nolock()) ffff984fc19ab000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788390384.409035:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000001:00000004:3.0:1788390384.409051:0:8798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788390384.409174:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+2:2403:x1875263088501632:12345-192.168.202.11@tcp:9:kworker.0 Request processed in 218us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390384.409181:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+2:2403:x1875263088501760:12345-192.168.202.11@tcp:9:kworker.0 Request processed in 209us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390384.409182:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:3.0:1788390384.409194:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 19 00010000:00010000:3.0:1788390384.409223:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788390384.409494:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390384.409505:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390384.409517:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390384.790219:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390385.084083:0:11289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:3.0:1788390385.809951:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390385.920520:0:11337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 2 19:06:25 EDT 2026 00000100:00100000:3.0:1788390386.257452:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098001664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390386.257462:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098001536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390386.260174:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390386.260196:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098001792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390386.261687:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390386.261688:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390386.261743:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098001536 00000100:00100000:1.0:1788390386.261752:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098001536 00000100:00100000:0.0:1788390386.261772:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390386.261812:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098001792 00000100:00100000:1.0:1788390386.261817:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098001792 00000100:00100000:3.0:1788390386.261846:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098001664 00000100:00100000:1.0:1788390386.261847:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788390386.261854:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098001664 00000100:00100000:1.0:1788390386.261861:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098001536:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390386.261895:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00002000:00000024:1.0:1788390386.261897:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390386.261908:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098001664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788390386.261937:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788390386.261942:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098001536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390386.261949:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788390386.261979:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788390386.261992:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098001792:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390386.261993:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098001664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390386.262005:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00002000:00000024:1.0:1788390386.262009:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390386.262024:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098001664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390386.262049:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098001792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390386.262054:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788390386.262060:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788390386.262101:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b2ce00 x1875263098001792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390386.262117:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098001792:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788390386.262382:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87af5180 x1875263098001536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390386.262411:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098001536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390386.770661:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098001920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390386.770726:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390386.770820:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098001920 00000100:00100000:0.0:1788390386.770829:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098001920 00000100:00100000:0.0:1788390386.770896:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788390386.770909:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098001920:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390386.770938:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098002432:0@lo:400:kworker.0 00002000:00000024:0.0:1788390386.770943:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390386.770969:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390386.770999:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098001920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (270us total) trans 0 rc 0/0 00010000:00080000:1.0:1788390386.771010:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8806b480 x1875263098001920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390386.771011:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788390386.771031:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098001920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390386.771053:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098002944:0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.771053:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098002048:0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.771102:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788390386.771207:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390386.773951:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390386.773999:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098003456:0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.773999:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098002560:0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.774054:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390386.774064:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098002432 00000100:00100000:1.0:1788390386.774071:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098002432 00000100:00100000:0.0:1788390386.774092:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098003072:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.774117:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098002944 00000100:00100000:1.0:1788390386.774122:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788390386.774123:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098002944 00000100:00100000:0.0:1788390386.774127:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390386.774138:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098002432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.774166:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098002560 00000100:00100000:0.0:1788390386.774166:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098003072 00000100:00100000:3.0:1788390386.774171:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098002560 00000100:00100000:0.0:1788390386.774174:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098003072 00000100:00100000:1.0:1788390386.774199:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098002432:12345-0@lo:400:kworker.0 Request processed in 63us (3227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390386.774203:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788390386.774213:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788390386.774215:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098002944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.774226:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390386.774240:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098003072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.774268:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098002944:12345-0@lo:400:kworker.0 Request processed in 55us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390386.774289:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098003072:12345-0@lo:400:kworker.0 Request processed in 53us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390386.774291:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788390386.774301:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390386.774312:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788390386.774347:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098002560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.774370:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098002176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390386.774392:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098002560:12345-0@lo:400:kworker.0 Request processed in 72us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390386.774399:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788390386.774407:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788390386.774431:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390386.774440:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098002688:0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.774466:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390386.774490:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098003200:0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.774512:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390386.774558:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098002048 00000100:00100000:0.0:1788390386.774563:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098002048 00000100:00100000:3.0:1788390386.774571:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098002688 00000100:00100000:3.0:1788390386.774577:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098002688 00000100:00100000:0.0:1788390386.774611:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788390386.774620:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788390386.774625:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098002048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.774632:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098002688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.774672:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098002048:12345-0@lo:400:kworker.0 Request processed in 52us (3569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390386.774681:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788390386.774687:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098002688:12345-0@lo:400:kworker.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390386.774695:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788390386.774700:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098002176 00000100:00100000:1.0:1788390386.774706:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098002176 00000100:00100000:0.0:1788390386.774731:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098002304:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.774735:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098002688:0@lo:400:kworker.0 00000100:00100000:1.0:1788390386.774753:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788390386.774757:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390386.774766:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098002176:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390386.774767:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788390386.774785:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390386.774807:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098002816:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.774810:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098002304 00000100:00100000:3.0:1788390386.774814:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098002304 00000100:00100000:1.0:1788390386.774834:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098002176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390386.774841:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788390386.774847:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390386.774847:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390386.774852:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098002304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.774876:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1875263098003328:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.774899:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098002304:12345-0@lo:400:kworker.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390386.774902:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098003200 00000100:00100000:2.0:1788390386.774908:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098003200 00000100:00100000:3.0:1788390386.774909:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788390386.774920:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390386.774939:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390386.774948:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098002816 00000100:00100000:2.0:1788390386.774950:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098003200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.774954:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098002816 00000100:00100000:0.0:1788390386.774968:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098002304:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.774992:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098003328 00000100:00100000:2.0:1788390386.774994:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098003200:12345-0@lo:400:kworker.0 Request processed in 46us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390386.775001:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098003328 00000100:00100000:2.0:1788390386.775006:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390386.775007:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390386.775024:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098003456 00000100:00100000:3.0:1788390386.775027:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098003456 00000100:00100000:0.0:1788390386.775042:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098002432:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.775043:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788390386.775055:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098002816:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788390386.775069:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b45c00 x1875263098002944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390386.775081:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098002944:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.775112:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098002816:12345-0@lo:400:kworker.0 Request processed in 57us (271us total) trans 0 rc 0/0 00010000:00080000:0.0:1788390386.775113:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b46300 x1875263098003072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390386.775123:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788390386.775135:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098002816:0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.775139:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098003072:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.775145:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788390386.775154:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098003584:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.775155:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875263098003328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.775198:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390386.775201:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875263098003328:12345-0@lo:400:kworker.0 Request processed in 49us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390386.775207:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788390386.775222:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788390386.775227:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098003456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390386.775238:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1875263098003328:0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.775246:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098002048:0@lo:400:kworker.0 00000100:00100000:0.0:1788390386.775265:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098002560:0@lo:400:kworker.0 00000100:00100000:3.0:1788390386.775272:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098003456:12345-0@lo:400:kworker.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390386.775280:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788390386.775292:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098003584 00000100:00100000:0.0:1788390386.775297:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098003584 00000100:00080000:3.0:1788390386.775300:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788390386.775304:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788390386.775341:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8806ad80 x1875263098002176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390386.775353:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390386.775360:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098002176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390386.775365:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098003584:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788390386.775380:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b47800 x1875263098003200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390386.775391:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098003200:0@lo:400:kworker.0 00000100:00100000:2.0:1788390386.775403:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098003584:12345-0@lo:400:kworker.0 Request processed in 42us (206us total) trans 0 rc 0/0 00010000:00080000:1.0:1788390386.776405:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b44e00 x1875263098003456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390386.776418:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098003456:0@lo:400:kworker.0 00010000:00080000:0.0:1788390386.776538:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b44000 x1875263098003584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390386.776549:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098003584:0@lo:400:kworker.0 00000100:00100000:2.0:1788390386.776648:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788390386.833449:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390387.857438:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390388.881438:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390389.329493:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390389.329518:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098003712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390389.329606:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390389.329671:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098003712 00000100:00100000:3.0:1788390389.329680:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098003712 00000100:00100000:3.0:1788390389.329733:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788390389.329742:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098003712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788390389.329777:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788390389.329824:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098003712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390389.329829:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788390389.329920:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098003712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390389.524167:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390389.524216:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390389.524303:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088502016 00000100:00100000:3.0:1788390389.524313:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088502016 00000100:00100000:3.0:1788390389.524388:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 91 00000100:00100000:3.0:1788390389.524399:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2407:x1875263088502016:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390389.524469:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2407:x1875263088502016:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 73us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390389.524477:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 91 00000100:00080000:3.0:1788390389.524499:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390389.524675:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390389.524868:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088502144 00000100:00100000:3.0:1788390389.524872:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088502144 00000100:00100000:3.0:1788390389.524918:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 92 00000100:00100000:3.0:1788390389.524927:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2406:x1875263088502144:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390389.524963:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2406:x1875263088502144:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 37us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390389.524970:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 92 00000100:00080000:2.0:1788390389.525203:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390389.525252:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088501888 00000100:00100000:1.0:1788390389.525257:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088501888 00000100:00100000:1.0:1788390389.525500:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 280 00000100:00100000:1.0:1788390389.525661:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2406:x1875263088501888:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390389.525739:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2406:x1875263088501888:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 82us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390389.525753:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 280 00010000:00010000:3.0:1788390389.906483:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788390390.355361:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:0.0:1788390390.355372:0:8402:0:(genops.c:885:class_export_put()) final put ffff984fc19af000/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:3.0:1788390390.355519:0:480:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc19af000/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa for lustre-OST0000 00000020:00000080:3.0:1788390390.355586:0:480:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc19aa800 for lustre-OST0000 00000001:00100000:3.0:1788390390.355986:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:3.0:1788390390.355989:0:9485:0:(genops.c:885:class_export_put()) final put ffff984fc19aa000/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:1.0:1788390390.356024:0:480:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc19aa000/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa for lustre-OST0001 00000020:00000080:1.0:1788390390.356068:0:480:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc19ab000 for lustre-OST0001 00010000:00010000:2.0:1788390390.929444:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390391.378584:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390391.378607:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098003840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390391.378671:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390391.378729:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098003840 00000100:00100000:3.0:1788390391.378737:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098003840 00000100:00100000:3.0:1788390391.378790:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788390391.378801:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098003840:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788390391.378883:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788390391.378929:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390391.379012:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098003840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 212us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390391.379019:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788390391.380188:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87af5880 x1875263098003840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390391.380208:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098003840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390391.381160:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390391.382732:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098003968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390391.382798:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390391.382947:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098003968 00000100:00100000:3.0:1788390391.382956:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098003968 00000100:00100000:3.0:1788390391.383019:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390391.383029:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098003968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390391.383063:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390391.383112:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098003968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390391.383119:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788390391.383155:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87af4a80 x1875263098003968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390391.383174:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098003968:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390391.383286:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390391.383446:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098004096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390391.383484:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390391.383560:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098004096 00000100:00100000:1.0:1788390391.383565:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098004096 00000100:00100000:1.0:1788390391.383599:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788390391.383606:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098004096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788390391.383629:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788390391.383658:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098004096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390391.383664:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788390391.383721:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098004096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788390391.889523:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098004224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390391.889604:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390391.889671:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098004224 00000100:00100000:0.0:1788390391.889676:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098004224 00000100:00100000:0.0:1788390391.889736:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788390391.889744:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098004224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390391.889767:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390391.889816:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098004224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390391.889823:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788390391.889847:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788390391.889883:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b2fb80 x1875263098004224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390391.889904:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098004224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390391.890236:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098004480:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.890266:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.890288:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098004992:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.890311:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.890355:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098005504:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.890388:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.890408:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788390391.890414:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098004352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390391.890435:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.890450:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098004864:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.890482:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.890499:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098005376:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.890517:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.890531:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098005888:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.890561:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.890586:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098004480 00000100:00100000:2.0:1788390391.890590:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098004480 00000100:00100000:2.0:1788390391.890613:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788390391.890617:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098004480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.890641:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098004480:12345-0@lo:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.890645:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788390391.890664:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098004992 00000100:00100000:2.0:1788390391.890666:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098004992 00000100:00100000:2.0:1788390391.890681:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788390391.890685:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098004992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.890704:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098004992:12345-0@lo:400:kworker.0 Request processed in 20us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.890708:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788390391.890720:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098005504 00000100:00100000:2.0:1788390391.890722:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098005504 00000100:00100000:2.0:1788390391.890757:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098005376 00000100:00100000:2.0:1788390391.890759:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098005376 00000100:00100000:2.0:1788390391.890771:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098005888 00000100:00100000:2.0:1788390391.890772:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098005888 00000100:00100000:2.0:1788390391.890788:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390391.890791:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098005504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.890815:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098005504:12345-0@lo:400:kworker.0 Request processed in 23us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390391.890820:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390391.890832:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098005376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390391.890882:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098005376:12345-0@lo:400:kworker.0 Request processed in 53us (363us total) trans 0 rc 0/0 00000100:00080000:1.0:1788390391.891370:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390391.891566:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390391.891576:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788390391.891592:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390391.891601:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098005888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.891635:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098005888:12345-0@lo:400:kworker.0 Request processed in 36us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.891640:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390391.891661:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098004352 00000100:00100000:2.0:1788390391.891665:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098004352 00000100:00100000:2.0:1788390391.891692:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788390391.891699:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098004352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788390391.891711:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390391.891740:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098004352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.891746:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788390391.891767:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098004864 00000100:00100000:2.0:1788390391.891770:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098004864 00000100:00100000:2.0:1788390391.891803:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788390391.891810:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098004864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.891839:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098004864:12345-0@lo:400:kworker.0 Request processed in 30us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.891849:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788390391.891875:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098004608:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.891896:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.891917:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098005120:0@lo:400:kworker.0 00000100:00100000:3.0:1788390391.891927:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098004608 00000100:00100000:3.0:1788390391.891932:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098004608 00000100:00100000:2.0:1788390391.891936:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390391.891993:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098005632:0@lo:400:kworker.0 00000100:00100000:3.0:1788390391.891995:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098005120 00000100:00100000:3.0:1788390391.891998:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098005120 00000100:00100000:2.0:1788390391.892018:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390391.892023:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788390391.892026:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098005632 00000100:00100000:3.0:1788390391.892030:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098005632 00000100:00100000:2.0:1788390391.892033:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788390391.892037:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098004608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892042:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098004736:0@lo:400:kworker.0 00000100:00100000:3.0:1788390391.892046:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788390391.892052:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098005120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892070:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390391.892097:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098005120:12345-0@lo:400:kworker.0 Request processed in 44us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.892101:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098005248:0@lo:400:kworker.0 00000100:00100000:0.0:1788390391.892104:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098004608:12345-0@lo:400:kworker.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390391.892106:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788390391.892116:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788390391.892125:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788390391.892125:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390391.892133:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098005632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390391.892137:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098005248 00000100:00100000:2.0:1788390391.892141:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098005760:0@lo:400:kworker.0 00000100:00100000:0.0:1788390391.892144:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098005248 00000100:00100000:3.0:1788390391.892159:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098005632:12345-0@lo:400:kworker.0 Request processed in 27us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.892165:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390391.892166:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788390391.892174:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098005760 00000100:00100000:0.0:1788390391.892178:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098005760 00000100:00100000:3.0:1788390391.892181:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788390391.892190:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098005248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892191:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098004608:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892203:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098005120:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892212:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098005632:0@lo:400:kworker.0 00000100:00100000:3.0:1788390391.892213:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098005248:12345-0@lo:400:kworker.0 Request processed in 26us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390391.892218:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1788390391.892231:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b46a00 x1875263098005248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390391.892234:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788390391.892240:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098005760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892241:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098005248:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892257:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098004736 00000100:00100000:2.0:1788390391.892261:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098004736 00000100:00100000:3.0:1788390391.892267:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098005760:12345-0@lo:400:kworker.0 Request processed in 27us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390391.892291:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788390391.892296:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788390391.892303:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098004736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892353:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098004736:12345-0@lo:400:kworker.0 Request processed in 51us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390391.892359:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1788390391.892412:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8806a300 x1875263098004352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390391.892429:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098004352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390391.892445:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098004864:0@lo:400:kworker.0 00000100:00080000:0.0:1788390391.892445:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788390391.892453:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788390391.892461:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b47480 x1875263098005376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390391.892470:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098005376:0@lo:400:kworker.0 00000100:00100000:3.0:1788390391.892472:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098004736:0@lo:400:kworker.0 00010000:00080000:2.0:1788390391.892479:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b44e00 x1875263098005888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788390391.892481:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b44000 x1875263098005760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390391.892487:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098005888:0@lo:400:kworker.0 00000100:00100000:3.0:1788390391.892489:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098005760:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892495:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098004480:0@lo:400:kworker.0 00000100:00100000:2.0:1788390391.892503:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098004992:0@lo:400:kworker.0 00010000:00080000:2.0:1788390391.892513:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b46d80 x1875263098005504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390391.892520:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098005504:0@lo:400:kworker.0 00010000:00010000:1.0:1788390391.953717:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390392.977495:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390393.602278:0:11965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:06:32 (1788390392) === 00000100:00100000:2.0:1788390393.988431:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390393.988562:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088502272 00000100:00100000:1.0:1788390393.988571:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088502272 00000100:00100000:1.0:1788390393.988629:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 282 00000100:00100000:1.0:1788390393.988639:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:8742:x1875263088502272:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788390393.988656:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390393.988672:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4c00/0xe156d0713be976af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243c96 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390393.988702:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4c00/0xe156d0713be976af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c96 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390393.988725:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4c00/0xe156d0713be976af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c96 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390393.988734:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4c00, rc 0) 00000100:00100000:1.0:1788390393.988792:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8742:x1875263088502272:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 153us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390393.988799:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 282 00000100:00100000:3.0:1788390393.992196:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390393.992308:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088502400 00000100:00100000:2.0:1788390393.992389:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088502400 00000100:00100000:2.0:1788390393.992460:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 283 00000100:00100000:2.0:1788390393.992471:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8742:x1875263088502400:12345-192.168.202.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788390393.992666:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8742:x1875263088502400:12345-192.168.202.11@tcp:501:mount.lustre.0 Request processed in 196us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390393.992676:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 283 00000100:00100000:3.0:1788390393.995502:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390393.995656:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088502528 00000100:00100000:2.0:1788390393.995668:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088502528 00000100:00100000:2.0:1788390393.995788:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 284 00000100:00100000:2.0:1788390393.995800:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8742:x1875263088502528:12345-192.168.202.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788390393.995985:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8742:x1875263088502528:12345-192.168.202.11@tcp:503:mount.lustre.0 Request processed in 187us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390393.995994:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 284 00000100:00100000:3.0:1788390393.997574:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390393.997670:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088502656 00000100:00100000:1.0:1788390393.997679:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088502656 00000100:00100000:1.0:1788390393.997731:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 285 00000100:00100000:1.0:1788390393.997740:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8746:x1875263088502656:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390393.997883:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8746:x1875263088502656:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 143us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390393.997890:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 285 00010000:00010000:1.0:1788390394.002998:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390394.020203:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390394.020414:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088502784 00000100:00100000:2.0:1788390394.020427:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088502784 00000100:00100000:2.0:1788390394.020510:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 286 00000100:00100000:2.0:1788390394.020523:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8746:x1875263088502784:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390394.020739:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8746:x1875263088502784:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 218us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.020747:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 286 00000100:00100000:3.0:1788390394.023497:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390394.026229:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088502912 00000100:00100000:0.0:1788390394.026605:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088502912 00000100:00100000:1.0:1788390394.027582:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 287 00000100:00100000:1.0:1788390394.027599:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8746:x1875263088502912:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390394.027817:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8746:x1875263088502912:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 221us (4334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.027825:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 287 00000100:00100000:3.0:1788390394.029880:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390394.029956:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088503040 00000100:00100000:1.0:1788390394.029967:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088503040 00000100:00100000:1.0:1788390394.030023:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 288 00000100:00100000:1.0:1788390394.030034:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+11:8742:x1875263088503040:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788390394.030208:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390394.030232:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5600/0xe156d0713be976b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243cc7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.030266:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5600/0xe156d0713be976b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cc7 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.030278:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5600/0xe156d0713be976b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cc7 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390394.030289:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5600, rc 0) 00000100:00100000:1.0:1788390394.030413:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+12:8742:x1875263088503040:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 380us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.030420:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 288 00000100:00100000:3.0:1788390394.033502:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390394.034210:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088503168 00000100:00100000:1.0:1788390394.034550:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088503168 00000100:00100000:1.0:1788390394.034673:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 289 00000100:00100000:1.0:1788390394.034694:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+12:8742:x1875263088503168:12345-192.168.202.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788390394.034728:0:6487:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788390394.034758:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788390394.034762:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788390394.034766:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788390394.034770:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788390394.034772:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788390394.039218:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+12:8742:x1875263088503168:12345-192.168.202.11@tcp:256:mount.lustre.0 Request processed in 4519us (5712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.039236:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 289 00000100:00100000:3.0:1788390394.043939:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390394.047784:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088503296 00000100:00100000:2.0:1788390394.047806:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088503296 00000100:00100000:2.0:1788390394.047948:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 290 00000100:00100000:2.0:1788390394.047960:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:8742:x1875263088503296:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788390394.048007:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390394.048044:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243cce expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.048087:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cce expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.048100:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cce expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390394.048111:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4e00, rc 0) 00000100:00100000:2.0:1788390394.048200:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:8742:x1875263088503296:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 241us (4273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.048208:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 290 00000100:00100000:3.0:1788390394.051099:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390394.051196:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088503424 00000100:00100000:1.0:1788390394.051227:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088503424 00000100:00100000:1.0:1788390394.051303:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 291 00000100:00100000:1.0:1788390394.051316:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:8742:x1875263088503424:12345-192.168.202.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788390394.051585:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:8742:x1875263088503424:12345-192.168.202.11@tcp:501:mount.lustre.0 Request processed in 270us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.051594:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 291 00000100:00100000:3.0:1788390394.055479:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390394.055704:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088503552 00000100:00100000:2.0:1788390394.055717:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088503552 00000100:00100000:2.0:1788390394.055837:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 292 00000100:00100000:2.0:1788390394.055849:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:8742:x1875263088503552:12345-192.168.202.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788390394.056079:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:8742:x1875263088503552:12345-192.168.202.11@tcp:503:mount.lustre.0 Request processed in 231us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.056088:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 292 00000100:00100000:3.0:1788390394.059457:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390394.059958:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088503680 00000100:00100000:0.0:1788390394.059971:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088503680 00000100:00100000:0.0:1788390394.060056:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 293 00000100:00100000:0.0:1788390394.060069:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:8750:x1875263088503680:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390394.060293:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:8750:x1875263088503680:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 225us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390394.060314:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 293 00000100:00100000:3.0:1788390394.064726:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390394.064894:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088503808 00000100:00100000:2.0:1788390394.064909:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088503808 00000100:00100000:2.0:1788390394.064986:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 294 00000100:00100000:2.0:1788390394.064999:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:8750:x1875263088503808:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390394.065220:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:8750:x1875263088503808:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 223us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.065236:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 294 00000100:00100000:3.0:1788390394.070691:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390394.070738:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390394.070775:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390394.070873:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088503936 00000100:00100000:0.0:1788390394.070887:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088503936 00000100:00100000:3.0:1788390394.070897:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390394.073766:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088504192 00000100:00100000:1.0:1788390394.073785:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088504192 00000100:00100000:1.0:1788390394.073824:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088504576 00000100:00100000:1.0:1788390394.073827:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088504576 00000100:00100000:1.0:1788390394.073916:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088504704 00000100:00100000:1.0:1788390394.073920:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088504704 00000100:00100000:0.0:1788390394.073954:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 99 00000100:00080000:3.0:1788390394.073963:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390394.073968:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088504576:12345-192.168.202.11@tcp:400:kworker.0 00000100:00080000:3.0:1788390394.073969:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390394.074097:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088504576:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 131us (3319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.074594:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:2.0:1788390394.074605:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875263088503936:12345-192.168.202.11@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788390394.074610:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 99 00000100:00100000:0.0:1788390394.074635:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:0.0:1788390394.074640:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875263088504192:12345-192.168.202.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788390394.074642:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5@192.168.202.11@tcp t0 exp 0000000000000000 cur 214 last 0 00010000:00080000:0.0:1788390394.074653:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5@192.168.202.11@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:0.0:1788390394.074685:0:6493:0:(genops.c:1385:class_connect()) connect: client ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5, cookie 0xe156d0713be976cb 00000020:00000080:2.0:1788390394.074696:0:6492:0:(genops.c:1385:class_connect()) connect: client ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5, cookie 0xe156d0713be976c4 00000004:00100000:2.0:1788390394.074717:0:6492:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:0.0:1788390394.074717:0:6493:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788390394.074870:0:6492:0:(import.c:65:import_set_state_nolock()) ffff984fc18b3000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788390394.074880:0:6493:0:(import.c:65:import_set_state_nolock()) ffff984e87a78800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390394.074916:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2403:x1875263088504192:12345-192.168.202.11@tcp:38:mount.lustre.0 Request processed in 274us (4177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.074921:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2403:x1875263088503936:12345-192.168.202.11@tcp:38:mount.lustre.0 Request processed in 317us (4255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390394.074923:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:2.0:1788390394.074927:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:1.0:1788390394.075386:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 100 00000100:00100000:1.0:1788390394.075399:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088504704:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390394.075488:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088504704:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 93us (4589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.075495:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 100 00000100:00100000:3.0:1788390394.078711:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390394.078758:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390394.078903:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088504320 00000100:00100000:0.0:1788390394.078916:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088504320 00000100:00100000:2.0:1788390394.078968:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088504064 00000100:00100000:2.0:1788390394.078973:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088504064 00000100:00080000:3.0:1788390394.079040:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390394.079045:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390394.079056:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:0.0:1788390394.079078:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:0:x1875263088504320:12345-192.168.202.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390394.079125:0:8996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788390394.079248:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:0:x1875263088504320:12345-192.168.202.11@tcp:41:mount.lustre.0 Request processed in 173us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390394.079268:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:0.0:1788390394.079295:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:0.0:1788390394.079303:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:0:x1875263088504064:12345-192.168.202.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390394.079349:0:8996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788390394.079394:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390394.079514:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:0:x1875263088504064:12345-192.168.202.11@tcp:41:mount.lustre.0 Request processed in 210us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390394.079521:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:0.0:1788390394.080053:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088504448 00000100:00100000:0.0:1788390394.080067:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088504448 00000100:00100000:0.0:1788390394.080091:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 20 00000100:00100000:0.0:1788390394.080098:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:8742:x1875263088504448:12345-192.168.202.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390394.080112:0:8996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788390394.080152:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:8742:x1875263088504448:12345-192.168.202.11@tcp:41:mount.lustre.0 Request processed in 54us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390394.080158:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 20 00000100:00100000:3.0:1788390394.081813:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390394.081899:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088504832 00000100:00100000:0.0:1788390394.081907:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088504832 00000100:00100000:0.0:1788390394.081957:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:0.0:1788390394.081964:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:8742:x1875263088504832:12345-192.168.202.11@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788390394.082077:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:8742:x1875263088504832:12345-192.168.202.11@tcp:40:mount.lustre.0 Request processed in 112us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390394.082085:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:3.0:1788390394.084397:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390394.084457:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390394.084507:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390394.084554:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088505216 00000100:00100000:1.0:1788390394.084567:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088505216 00000100:00100000:2.0:1788390394.084598:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088504960 00000100:00100000:2.0:1788390394.084602:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088504960 00000100:00100000:2.0:1788390394.084628:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088505088 00000100:00100000:2.0:1788390394.084630:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088505088 00000100:00100000:1.0:1788390394.084633:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:1.0:1788390394.084644:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:8742:x1875263088505216:12345-192.168.202.11@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788390394.084646:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 20 00000100:00100000:2.0:1788390394.084650:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875263088504960:12345-192.168.202.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788390394.084681:0:8408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5@192.168.202.11@tcp t0 exp 0000000000000000 cur 214 last 0 00000100:00100000:1.0:1788390394.084726:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:8742:x1875263088505216:12345-192.168.202.11@tcp:900:mount.lustre.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000020:00000080:2.0:1788390394.084730:0:8408:0:(genops.c:1385:class_connect()) connect: client ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5, cookie 0xe156d0713be976d2 00000100:00100000:1.0:1788390394.084734:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 5 00002000:00100000:2.0:1788390394.084744:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5/ffff984fc18b0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788390394.084766:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788390394.084863:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788390394.084879:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:1.0:1788390394.084883:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbf8ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1875263088505088:12345-192.168.202.11@tcp:8:mount.lustre.0 00000100:00080000:2.0:1788390394.084899:0:8408:0:(import.c:65:import_set_state_nolock()) ffff984fc18b4000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1788390394.084907:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5@192.168.202.11@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1788390394.084922:0:8409:0:(genops.c:1385:class_connect()) connect: client ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5, cookie 0xe156d0713be976d9 00002000:00100000:1.0:1788390394.084927:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5/ffff984e877d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788390394.084932:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2403:x1875263088504960:12345-192.168.202.11@tcp:8:mount.lustre.0 Request processed in 281us (548us total) trans 0 rc 0/0 00002000:00100000:1.0:1788390394.084940:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788390394.084946:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 20 00002000:00080000:1.0:1788390394.084983:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788390394.084999:0:8409:0:(import.c:65:import_set_state_nolock()) ffff984e877d6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390394.085021:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbf8ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2403:x1875263088505088:12345-192.168.202.11@tcp:8:mount.lustre.0 Request processed in 135us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390394.085028:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:3.0:1788390394.088778:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390394.088955:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088505344 00000100:00100000:0.0:1788390394.088968:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088505344 00000100:00100000:0.0:1788390394.089119:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 1 00000100:00100000:0.0:1788390394.089134:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:8742:x1875263088505344:12345-192.168.202.11@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788390394.089500:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788390394.089619:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:8742:x1875263088505344:12345-192.168.202.11@tcp:33:mount.lustre.0 Request processed in 488us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390394.089628:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 1 00000100:00100000:3.0:1788390394.453529:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098006016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788390394.453642:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390394.454674:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098006016 00000100:00100000:2.0:1788390394.454690:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098006016 00000100:00100000:2.0:1788390394.454768:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788390394.454781:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098006016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390394.454828:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788390394.454919:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098006016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390394.454928:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788390394.455698:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098006016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788390395.038098:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390396.049547:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390396.497870:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098006400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390396.497961:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390396.497987:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098006144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788390396.498021:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390396.498057:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098006272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788390396.498083:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390396.498108:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098006272 00000100:00100000:2.0:1788390396.498116:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098006272 00000100:00100000:2.0:1788390396.498168:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788390396.498179:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098006272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788390396.498211:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788390396.498253:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098006272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390396.498262:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788390396.498293:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098006272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390396.498345:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098006400 00000100:00100000:3.0:1788390396.498349:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098006400 00000100:00100000:3.0:1788390396.498388:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098006144 00000100:00100000:3.0:1788390396.498391:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098006144 00000100:00100000:3.0:1788390396.498405:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390396.498412:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098006400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390396.498429:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390396.498462:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098006400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390396.498468:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390396.498481:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788390396.498488:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098006144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390396.498497:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788390396.498532:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b2e300 x1875263098006400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390396.498549:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098006400:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390396.498595:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390396.501631:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098006144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3129us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390396.501647:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788390396.501793:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e878bce00 x1875263098006144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390396.501818:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098006144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390397.009673:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098006912:0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.009748:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390397.010048:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1875263098007424:0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.010084:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390397.010210:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788390397.010217:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098006528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390397.010242:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390397.012438:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098006528 00000100:00100000:1.0:1788390397.012448:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098007040:0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.012451:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098006528 00000100:00100000:0.0:1788390397.012488:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098006912 00000100:00100000:0.0:1788390397.012508:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098006912 00000100:00100000:1.0:1788390397.012519:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390397.012524:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788390397.012535:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098006528:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390397.012552:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098007552:0@lo:400:kworker.0 00000100:00100000:0.0:1788390397.012554:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00002000:00000024:3.0:1788390397.012563:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390397.012569:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098006912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.012580:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390397.012606:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098007936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390397.012609:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098006528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390397.012616:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788390397.012621:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098006912:12345-0@lo:400:kworker.0 Request processed in 56us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390397.012630:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788390397.012635:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390397.012640:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098007424 00000100:00100000:3.0:1788390397.012644:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098007424 00000100:00100000:0.0:1788390397.012662:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098006656:0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.012671:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098007040 00010000:00080000:1.0:1788390397.012671:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87a67b80 x1875263098006528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390397.012674:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098007040 00000100:00100000:3.0:1788390397.012690:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098007552 00000100:00100000:1.0:1788390397.012691:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098006528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390397.012692:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098007552 00000100:00100000:0.0:1788390397.012701:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390397.012708:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788390397.012708:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098006912:0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.012717:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875263098007424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390397.012738:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098007168:0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.012762:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875263098007424:12345-0@lo:400:kworker.0 Request processed in 46us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390397.012762:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788390397.012769:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390397.012773:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098007040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.012774:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788390397.012788:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098007168 00000100:00100000:0.0:1788390397.012790:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098007680:0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.012792:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098007168 00000100:00100000:1.0:1788390397.012808:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098007040:12345-0@lo:400:kworker.0 Request processed in 39us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390397.012814:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788390397.012821:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390397.012842:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788390397.012844:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788390397.012851:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098006784:0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.012856:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098007552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390397.012876:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390397.012888:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098007296:0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.012904:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098007552:12345-0@lo:400:kworker.0 Request processed in 51us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390397.012913:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788390397.012914:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390397.012926:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098007808:0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.012943:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098006784 00000100:00100000:1.0:1788390397.012949:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098006784 00000100:00100000:0.0:1788390397.012955:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390397.012968:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098007296 00000100:00100000:1.0:1788390397.012972:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098007296 00000100:00100000:0.0:1788390397.012990:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788390397.012998:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788390397.013003:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788390397.013003:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098007168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.013008:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098006784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.013012:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1788390397.013033:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788390397.013038:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390397.013040:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390397.013052:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788390397.013057:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098007168:12345-0@lo:400:kworker.0 Request processed in 58us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390397.013059:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098006784:12345-0@lo:400:kworker.0 Request processed in 53us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390397.013062:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788390397.013072:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788390397.013073:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098007296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.013078:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788390397.013099:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098006656 00000100:00100000:0.0:1788390397.013112:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098006656 00000100:00100000:1.0:1788390397.013122:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098007936 00000100:00100000:1.0:1788390397.013127:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098007936 00000100:00100000:0.0:1788390397.013147:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788390397.013156:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098006656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.013166:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788390397.013170:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098007296:12345-0@lo:400:kworker.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390397.013175:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098007936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390397.013183:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00002000:00000024:1.0:1788390397.013186:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390397.013188:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098006656:12345-0@lo:400:kworker.0 Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390397.013197:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788390397.013223:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098007936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390397.013230:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788390397.013242:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098006784:0@lo:400:kworker.0 00000100:00080000:1.0:1788390397.013250:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788390397.013257:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88068e00 x1875263098007296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390397.013269:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098007296:0@lo:400:kworker.0 00010000:00080000:1.0:1788390397.013272:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b2e300 x1875263098007936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390397.013283:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098006656:0@lo:400:kworker.0 00000100:00100000:1.0:1788390397.013288:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098007936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390397.013297:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098007168:0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.013307:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098007680 00000100:00100000:3.0:1788390397.013312:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098007680 00000100:00100000:1.0:1788390397.013342:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098007040:0@lo:400:kworker.0 00010000:00080000:1.0:1788390397.013356:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8806a300 x1875263098007552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390397.013365:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098007552:0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.013366:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098007808 00000100:00100000:3.0:1788390397.013369:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098007808 00000100:00100000:1.0:1788390397.013378:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1875263098007424:0@lo:400:kworker.0 00000100:00100000:0.0:1788390397.013381:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788390397.013393:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098007680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390397.013401:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390397.013410:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098007808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390397.013433:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098007680:12345-0@lo:400:kworker.0 Request processed in 44us (611us total) trans 0 rc 0/0 00010000:00080000:1.0:1788390397.013446:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88069c00 x1875263098007680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390397.013450:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098007808:12345-0@lo:400:kworker.0 Request processed in 41us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390397.013454:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390397.013462:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390397.013462:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098007680:0@lo:400:kworker.0 00010000:00080000:1.0:1788390397.013481:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8806ad80 x1875263098007808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390397.013489:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098007808:0@lo:400:kworker.0 00010000:00010000:1.0:1788390397.074790:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390397.380145:0:12158:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788390398.099449:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390399.121681:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390399.253270:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390399.253307:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390399.253315:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088505600 00000100:00100000:0.0:1788390399.253347:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088505600 00000100:00100000:1.0:1788390399.253356:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390399.253368:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088505472 00000100:00100000:3.0:1788390399.253375:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088505472 00000100:00100000:1.0:1788390399.253386:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390399.253416:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390399.253417:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088505856 00000100:00100000:0.0:1788390399.253422:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088505856 00000100:00100000:3.0:1788390399.253434:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 296 00000100:00100000:3.0:1788390399.253449:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088505472:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390399.253450:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088505728 00000100:00100000:0.0:1788390399.253455:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088505728 00000100:00100000:1.0:1788390399.253458:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390399.253476:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088505984 00000100:00100000:0.0:1788390399.253491:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088505984 00000100:00100000:0.0:1788390399.253510:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 107 00000100:00100000:0.0:1788390399.253518:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2406:x1875263088505600:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390399.253525:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390399.253539:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088505472:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.253548:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 296 00000100:00100000:0.0:1788390399.253564:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2406:x1875263088505600:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 44us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390399.253573:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 107 00000100:00100000:3.0:1788390399.253595:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 108 00000100:00100000:3.0:1788390399.253604:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2406:x1875263088505856:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390399.253611:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 109 00000100:00100000:0.0:1788390399.253622:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088505728:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390399.253637:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2406:x1875263088505856:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 34us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.253646:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 108 00000100:00100000:0.0:1788390399.253658:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088505728:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 37us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.253667:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 110 00000100:00100000:0.0:1788390399.253676:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 109 00000100:00100000:3.0:1788390399.253682:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2407:x1875263088505984:12345-192.168.202.11@tcp:400:kworker.0 00000100:00080000:1.0:1788390399.253701:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390399.253707:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390399.253720:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2407:x1875263088505984:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 45us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390399.253726:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088506112 00000100:00100000:1.0:1788390399.253732:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088506112 00000100:00100000:3.0:1788390399.253737:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 110 00000100:00100000:1.0:1788390399.253780:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088506240 00000100:00100000:1.0:1788390399.253784:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088506240 00000100:00100000:1.0:1788390399.253815:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:1.0:1788390399.253824:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2406:x1875263088506112:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390399.253867:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2406:x1875263088506112:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 43us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.253873:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 32 00000100:00100000:1.0:1788390399.253882:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:3.0:1788390399.253886:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2407:x1875263088506240:12345-192.168.202.11@tcp:400:kworker.0 00000100:00080000:1.0:1788390399.253922:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390399.253931:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2407:x1875263088506240:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 49us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390399.253938:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 32 00000100:00080000:1.0:1788390399.254810:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390399.569930:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098008064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390399.569988:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390399.570108:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098008064 00000100:00100000:2.0:1788390399.570116:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098008064 00000100:00100000:2.0:1788390399.570161:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788390399.570170:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098008064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390399.570650:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788390399.570706:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098008064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 537us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390399.570714:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788390399.570815:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098008064:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788390399.572849:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000001:00100000:2.0:1788390399.573416:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000001:00100000:1.0:1788390399.573722:0:7423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000001:00100000:0.0:1788390399.573768:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00010000:00010000:0.0:1788390400.145461:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390401.169480:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788390401.342342:0:12473:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390401.343938:0:12473:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788390401.617584:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098008192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390401.617688:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390401.617792:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098008192 00000100:00100000:1.0:1788390401.617801:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098008192 00000100:00100000:1.0:1788390401.618104:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788390401.618117:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098008192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788390401.618163:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788390401.618214:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098008192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390401.618222:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788390401.618275:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098008192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390401.618292:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390401.618298:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098008320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390401.618354:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390401.618385:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098008320 00000100:00100000:0.0:1788390401.618390:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098008320 00000100:00100000:0.0:1788390401.618443:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390401.618451:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098008320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390401.618505:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390401.618546:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098008320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390401.618554:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788390401.618959:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390401.618968:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390401.618980:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098008448:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788390401.618989:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fb76e1880 x1875263098008320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390401.619006:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098008320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390401.619104:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390401.619249:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098008448 00000100:00100000:0.0:1788390401.619256:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098008448 00000100:00100000:0.0:1788390401.619314:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788390401.619344:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098008448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788390401.619361:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788390401.619365:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390401.619408:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098008448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390401.619415:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788390401.619491:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e878bc000 x1875263098008448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390401.619513:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098008448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390402.129556:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788390402.129587:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098008704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390402.129733:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098009216:0@lo:400:kworker.0 00000100:00100000:1.0:1788390402.129746:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098008832:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.129779:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390402.129801:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390402.129851:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098009728:0@lo:400:kworker.0 00000100:00100000:1.0:1788390402.129855:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098009344:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.129884:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390402.129901:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875263098008960:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.129927:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788390402.129933:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098009216 00000100:00100000:1.0:1788390402.129934:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390402.129936:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098009088:0@lo:400:kworker.0 00000100:00100000:2.0:1788390402.129945:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098009216 00000100:00100000:1.0:1788390402.129967:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098009472:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.129974:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390402.130001:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390402.130005:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263098009600:0@lo:400:kworker.0 00000100:00100000:0.0:1788390402.130027:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390402.130059:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098008576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390402.130078:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098009728 00000100:00100000:2.0:1788390402.130083:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098009728 00000100:00100000:1.0:1788390402.130097:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098009984:0@lo:400:kworker.0 00000100:00100000:0.0:1788390402.130097:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390402.130123:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098008960 00000100:00100000:2.0:1788390402.130128:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098008960 00000100:00100000:1.0:1788390402.130139:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390402.130139:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098009472 00000100:00100000:0.0:1788390402.130146:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098009472 00000100:00100000:2.0:1788390402.130153:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788390402.130166:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098009216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390402.130180:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788390402.130191:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788390402.130192:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098009728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390402.130204:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875263098008960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390402.130248:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098009216:12345-0@lo:400:kworker.0 Request processed in 84us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390402.130270:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788390402.130282:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098009728:12345-0@lo:400:kworker.0 Request processed in 61us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390402.130290:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788390402.130305:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788390402.130316:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098009472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390402.130340:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098008704 00000100:00100000:0.0:1788390402.130344:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098008704 00000100:00100000:0.0:1788390402.130373:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098008576 00000100:00100000:0.0:1788390402.130376:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098008576 00000100:00100000:0.0:1788390402.130392:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390402.130398:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098008704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390402.130424:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390402.132344:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875263098008960:12345-0@lo:400:kworker.0 Request processed in 2138us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390402.132357:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788390402.132406:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098008832 00000100:00100000:1.0:1788390402.132413:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098008832 00000100:00100000:1.0:1788390402.132467:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788390402.132475:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098008704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2074us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390402.132480:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098008832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390402.132490:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390402.132518:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390402.132529:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098008576:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390402.132537:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098008832:12345-0@lo:400:kworker.0 Request processed in 61us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390402.132544:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00002000:00000024:0.0:1788390402.132548:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390402.132591:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098008576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (2495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390402.132599:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788390402.132607:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098009984 00000100:00100000:1.0:1788390402.132623:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098009984 00010000:00080000:0.0:1788390402.132656:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fb76e1880 x1875263098008704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390402.132657:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788390402.132668:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098009984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390402.132692:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098008704:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788390402.132711:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87a65f80 x1875263098008576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390402.132724:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098008576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390402.132753:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098009472:12345-0@lo:400:kworker.0 Request processed in 2438us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390402.132763:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788390402.132794:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098009088 00000100:00100000:2.0:1788390402.132800:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098009088 00000100:00100000:2.0:1788390402.132831:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788390402.132840:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098009088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390402.132884:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098009088:12345-0@lo:400:kworker.0 Request processed in 46us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390402.132891:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788390402.132917:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390402.132924:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390402.133094:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390402.133134:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098009216:0@lo:400:kworker.0 00010000:00080000:3.0:1788390402.133148:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741aa00 x1875263098009728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390402.133156:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098009728:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.133176:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098009088:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.133213:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390402.133242:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098009856:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.133271:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390402.133299:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098008832:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.133345:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098009856 00000100:00100000:3.0:1788390402.133350:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098009856 00000100:00100000:3.0:1788390402.133377:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788390402.133384:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098009856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.133421:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098009856:12345-0@lo:400:kworker.0 Request processed in 37us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390402.133428:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788390402.133469:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741b800 x1875263098009856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390402.133479:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098009856:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.133498:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098009600 00000100:00100000:3.0:1788390402.133501:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098009600 00000100:00100000:3.0:1788390402.133532:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098009344 00000100:00100000:3.0:1788390402.133536:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098009344 00000100:00100000:3.0:1788390402.133556:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788390402.133562:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263098009600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.133599:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263098009600:12345-0@lo:400:kworker.0 Request processed in 37us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390402.133606:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788390402.133617:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788390402.133623:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098009344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.133660:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098009344:12345-0@lo:400:kworker.0 Request processed in 38us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390402.133664:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1788390402.133674:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390402.133685:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098009344:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.133699:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263098009600:0@lo:400:kworker.0 00000100:00100000:3.0:1788390402.134441:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875263098008960:0@lo:400:kworker.0 00010000:00080000:3.0:1788390402.134473:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb219880 x1875263098009472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390402.134483:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098009472:0@lo:400:kworker.0 00010000:00080000:3.0:1788390402.134496:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb2a9880 x1875263098009984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390402.134505:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098009984:0@lo:400:kworker.0 00000100:00100000:1.0:1788390402.134845:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098009984:12345-0@lo:400:kworker.0 Request processed in 2175us (4704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390402.134856:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1788390402.194673:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788390402.663899:0:12570:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390402.664198:0:12570:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788390403.218832:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788390403.917147:0:12667:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788390403.917414:0:12667:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788390404.241453:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390404.376138:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390404.376174:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390404.376192:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390404.376224:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390404.376255:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390404.376271:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390404.376493:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390404.376525:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088506368 00000100:00100000:0.0:1788390404.376535:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088506368 00000100:00100000:0.0:1788390404.376588:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 298 00000100:00100000:0.0:1788390404.376599:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2406:x1875263088506368:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390404.376666:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2406:x1875263088506368:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 69us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390404.376674:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 298 00000100:00100000:0.0:1788390404.376710:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088506496 00000100:00100000:0.0:1788390404.376714:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088506496 00000100:00100000:0.0:1788390404.376745:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088506752 00000100:00100000:0.0:1788390404.376748:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088506752 00000100:00100000:0.0:1788390404.376762:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088506624 00000100:00100000:0.0:1788390404.376765:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088506624 00000100:00100000:0.0:1788390404.376776:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088506880 00000100:00100000:0.0:1788390404.376778:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088506880 00000100:00100000:0.0:1788390404.376793:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 117 00000100:00100000:0.0:1788390404.376800:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2406:x1875263088506496:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390404.376834:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2406:x1875263088506496:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 33us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390404.376841:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 117 00000100:00100000:0.0:1788390404.376854:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 118 00000100:00100000:0.0:1788390404.376861:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088506752:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390404.376886:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088506752:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390404.376904:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 118 00000100:00100000:0.0:1788390404.376918:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 119 00000100:00100000:0.0:1788390404.376925:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088506624:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390404.377141:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 120 00000100:00100000:1.0:1788390404.377154:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088506880:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390404.377190:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088506880:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 41us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390404.377646:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088507008 00000100:00100000:2.0:1788390404.377651:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088507008 00000100:00100000:2.0:1788390404.377686:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088507136 00000100:00100000:2.0:1788390404.377689:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088507136 00000100:00100000:2.0:1788390404.377714:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:2.0:1788390404.377722:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088507008:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390404.377760:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088507008:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 39us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390404.377768:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:2.0:1788390404.377782:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 36 00000100:00100000:2.0:1788390404.377788:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088507136:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390404.377814:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088507136:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 26us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390404.377820:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 36 00000100:00080000:2.0:1788390404.377901:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390404.377906:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390404.377909:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788390404.377911:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390404.378016:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 120 00000100:00100000:0.0:1788390404.378333:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088506624:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 1395us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390404.378340:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 119 00000100:00100000:1.0:1788390404.690500:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098010112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390404.690567:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390404.690765:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098010112 00000100:00100000:2.0:1788390404.690785:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098010112 00000100:00100000:2.0:1788390404.690939:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788390404.690948:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098010112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390404.690976:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788390404.691021:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098010112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390404.691026:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788390404.691068:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098010112:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788390405.069957:0:12765:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390405.070160:0:12765:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788390405.267523:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788390406.178075:0:12863:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788390406.178300:0:12863:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788390406.290569:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390406.740744:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098010240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390406.740821:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390406.740866:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098010368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390406.740908:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390406.740945:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098010368 00000100:00100000:1.0:1788390406.740951:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098010240 00000100:00100000:0.0:1788390406.740954:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098010368 00000100:00100000:1.0:1788390406.740957:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098010240 00000100:00100000:1.0:1788390406.741009:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788390406.741013:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788390406.741024:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098010240:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390406.741025:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098010368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788390406.741059:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:1.0:1788390406.741060:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390406.741116:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098010368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390406.741122:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098010240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390406.741126:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788390406.741137:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788390406.741163:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390406.741186:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098010368:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1788390406.741217:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88039c00 x1875263098010240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390406.741243:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098010240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390406.741572:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098010496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390406.741606:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390406.741701:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098010496 00000100:00100000:0.0:1788390406.741714:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098010496 00000100:00100000:0.0:1788390406.741808:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788390406.741815:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098010496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788390406.741827:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390406.741863:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098010496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390406.741869:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788390406.741897:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87a65c00 x1875263098010496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390406.741911:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098010496:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788390406.741979:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390407.251248:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098010624:0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.251268:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263098010752:0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.251354:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390407.251366:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390407.251437:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098011264:0@lo:400:kworker.0 00000100:00100000:2.0:1788390407.251451:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098010880:0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.251466:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390407.251494:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390407.251502:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098011776:0@lo:400:kworker.0 00000100:00100000:2.0:1788390407.251516:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098011392:0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.251534:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390407.251542:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390407.251562:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098011904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390407.251565:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788390407.251574:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098011136:0@lo:400:kworker.0 00000100:00100000:2.0:1788390407.251579:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390407.251600:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788390407.251606:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098011008:0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.251616:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390407.251633:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098010880 00000100:00100000:2.0:1788390407.251638:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098010880 00000100:00100000:3.0:1788390407.251653:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098011648:0@lo:400:kworker.0 00000100:00100000:2.0:1788390407.251674:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788390407.251684:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098010880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.251685:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390407.251724:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098010752 00000100:00100000:3.0:1788390407.251729:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098010752 00000100:00100000:2.0:1788390407.251729:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098010880:12345-0@lo:400:kworker.0 Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390407.251738:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788390407.251772:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098011264 00000100:00100000:3.0:1788390407.251777:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098011264 00000100:00100000:0.0:1788390407.251816:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098012032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390407.251842:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390407.251869:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098011904 00000100:00100000:0.0:1788390407.251873:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098011904 00000100:00100000:0.0:1788390407.251902:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098012032 00000100:00100000:0.0:1788390407.251905:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098012032 00000100:00100000:0.0:1788390407.251937:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788390407.251946:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098011904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788390407.251970:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390407.252001:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098011904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390407.252006:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788390407.252020:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788390407.252025:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098012032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390407.252128:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098011392 00000100:00100000:3.0:1788390407.252131:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098011136 00000100:00100000:3.0:1788390407.252138:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098011136 00000100:00100000:2.0:1788390407.252139:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098011392 00000100:00100000:3.0:1788390407.252166:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788390407.252175:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263098010752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.252217:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263098010752:12345-0@lo:400:kworker.0 Request processed in 43us (864us total) trans 0 rc 0/0 00002000:00000024:0.0:1788390407.252759:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390407.252796:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098012032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 770us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390407.252804:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788390407.252844:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8803b800 x1875263098012032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390407.252859:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098012032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390407.255223:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788390407.255451:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098011264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390407.255495:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788390407.255507:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098011136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390407.255536:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098011264:12345-0@lo:400:kworker.0 Request processed in 92us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390407.255548:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788390407.255553:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098011136:12345-0@lo:400:kworker.0 Request processed in 48us (3935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390407.255562:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788390407.255579:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788390407.255588:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788390407.255609:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098011776 00000100:00100000:0.0:1788390407.255617:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098011776 00000100:00100000:3.0:1788390407.255619:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098011648 00000100:00100000:3.0:1788390407.255625:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098011648 00000100:00100000:2.0:1788390407.255708:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098011392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390407.255757:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098011392:12345-0@lo:400:kworker.0 Request processed in 170us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390407.255765:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788390407.255769:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788390407.255777:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390407.255781:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098011776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.255787:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098011648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.255827:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098011648:12345-0@lo:400:kworker.0 Request processed in 44us (4145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390407.255832:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390407.255838:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098011776:12345-0@lo:400:kworker.0 Request processed in 60us (4303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390407.255845:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788390407.255851:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390407.255856:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390407.255859:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390407.255886:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098010624 00000100:00100000:0.0:1788390407.255891:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098010624 00000100:00100000:3.0:1788390407.255894:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098011136:0@lo:400:kworker.0 00010000:00080000:3.0:1788390407.255908:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87a64700 x1875263098011648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390407.255926:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098011648:0@lo:400:kworker.0 00010000:00080000:3.0:1788390407.255937:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87a65f80 x1875263098011264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390407.255942:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098011264:0@lo:400:kworker.0 00010000:00080000:3.0:1788390407.255948:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b46300 x1875263098011776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390407.255953:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098011776:0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.255961:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263098010752:0@lo:400:kworker.0 00000100:00100000:0.0:1788390407.255986:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788390407.255999:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263098010624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.256108:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098010624:0@lo:400:kworker.0 00000100:00100000:0.0:1788390407.256112:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263098010624:12345-0@lo:400:kworker.0 Request processed in 115us (4745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390407.256130:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788390407.256170:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390407.256202:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098011008 00000100:00100000:3.0:1788390407.256205:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098011008 00000100:00100000:0.0:1788390407.256211:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098011520:0@lo:400:kworker.0 00000100:00100000:0.0:1788390407.256242:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390407.256268:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098010880:0@lo:400:kworker.0 00000100:00100000:0.0:1788390407.256278:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098011392:0@lo:400:kworker.0 00010000:00080000:0.0:1788390407.256373:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b46d80 x1875263098011904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390407.256390:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098011904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390407.257286:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098011520 00000100:00100000:3.0:1788390407.257290:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098011520 00000100:00100000:3.0:1788390407.257340:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788390407.257349:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098011008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390407.257394:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788390407.257419:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098011520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390407.257422:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098011008:12345-0@lo:400:kworker.0 Request processed in 73us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390407.257431:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788390407.257454:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390407.257462:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098011520:12345-0@lo:400:kworker.0 Request processed in 59us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390407.257470:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788390407.257525:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098011008:0@lo:400:kworker.0 00010000:00080000:0.0:1788390407.257540:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87a65180 x1875263098011520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390407.257549:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098011520:0@lo:400:kworker.0 00010000:00010000:3.0:1788390407.313516:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390408.166135:0:13007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788390408.337494:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390409.361770:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390409.493521:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390409.493878:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088507264 00000100:00100000:1.0:1788390409.493889:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088507264 00000100:00100000:1.0:1788390409.493984:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 300 00000100:00100000:1.0:1788390409.493994:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2405:x1875263088507264:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390409.494069:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2405:x1875263088507264:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 76us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390409.494078:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 300 00000100:00100000:1.0:1788390409.495635:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390409.495702:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390409.495780:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390409.495830:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088507392 00000100:00100000:3.0:1788390409.495837:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088507392 00000100:00100000:3.0:1788390409.495892:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088507648 00000100:00100000:3.0:1788390409.495896:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088507648 00000100:00100000:3.0:1788390409.495921:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 127 00000100:00100000:3.0:1788390409.495931:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088507392:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390409.495991:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088507392:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 61us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390409.495999:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 127 00000100:00100000:3.0:1788390409.496017:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 128 00000100:00100000:3.0:1788390409.496024:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088507648:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390409.496047:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088507648:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 24us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390409.496054:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 128 00000100:00080000:3.0:1788390409.496069:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390409.496210:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390409.496231:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390409.496254:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390409.496274:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088507904 00000100:00100000:1.0:1788390409.496278:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088507904 00000100:00100000:1.0:1788390409.496309:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088508032 00000100:00100000:1.0:1788390409.496313:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088508032 00000100:00100000:1.0:1788390409.496451:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:1.0:1788390409.496459:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088507904:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390409.496496:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088507904:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 37us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390409.496502:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:1.0:1788390409.496515:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00100000:1.0:1788390409.496526:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2405:x1875263088508032:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390409.496553:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2405:x1875263088508032:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390409.496558:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00080000:1.0:1788390409.496579:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390409.496582:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390409.496613:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088507520 00000100:00100000:1.0:1788390409.496617:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088507520 00000100:00100000:1.0:1788390409.496638:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088507776 00000100:00100000:1.0:1788390409.496640:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088507776 00000100:00100000:1.0:1788390409.496656:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 129 00000100:00100000:1.0:1788390409.496662:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088507520:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390409.496690:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088507520:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 28us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390409.496695:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 129 00000100:00100000:1.0:1788390409.496707:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 130 00000100:00100000:1.0:1788390409.496713:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2405:x1875263088507776:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390409.496733:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2405:x1875263088507776:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 21us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390409.496739:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 130 00000100:00080000:1.0:1788390409.496753:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390409.810471:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098012160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788390409.810551:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390409.810598:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098012160 00000100:00100000:2.0:1788390409.810606:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098012160 00000100:00100000:2.0:1788390409.810649:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788390409.810657:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098012160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390409.810687:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788390409.810741:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098012160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390409.810746:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788390409.811084:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098012160:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1788390410.131188:0:13154:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd70b4a540 20000000:00000080:2.0:1788390410.131208:0:13154:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984fb79b5c00 uarg=0000000000000000 20000000:01000000:2.0:1788390410.131247:0:13154:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788390410.131253:0:13154:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788390410.131257:0:13154:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788390410.131783:0:13155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788390410.131934:0:13154:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788390410.136083:0:13154:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788390410.136123:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136143:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c8f expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136152:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97677 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136160:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97685 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136166:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97693 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136173:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be976a1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136180:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cce expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136186:0:13154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136227:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cce expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136241:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cce expref: 12 pid: 6484 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.136254:0:13154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012288:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390410.136430:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be976a1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136439:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be976a1 expref: 23 pid: 6484 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.136449:0:13154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012416:0@lo:104: 00000100:00100000:2.0:1788390410.136495:0:13154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390410.136541:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97693 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136551:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97693 expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390410.136555:0:10310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098012416 00000100:00100000:3.0:1788390410.136563:0:10310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098012416 00000100:00100000:2.0:1788390410.136567:0:13154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b45880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012544:0@lo:104: 00000100:00100000:2.0:1788390410.136594:0:13154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390410.136614:0:10310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098012544 00000100:00100000:3.0:1788390410.136617:0:10310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098012544 00000100:00100000:3.0:1788390410.136633:0:10310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788390410.136636:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97685 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390410.136645:0:10310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+4:13154:x1875263098012416:12345-0@lo:104: 00010000:00010000:2.0:1788390410.136647:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97685 expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390410.136653:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788390410.136657:0:10310:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.136667:0:13154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012672:0@lo:104: 00000100:00100000:0.0:1788390410.136669:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:13154:x1875263098012544:12345-0@lo:104: 00010000:00010000:0.0:1788390410.136681:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.136704:0:13154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390410.136723:0:10310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788390410.136729:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97677 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136742:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97677 expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390410.136745:0:10310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+4:13154:x1875263098012416:12345-0@lo:104: Request processed in 102us (248us total) trans 0 rc 0/0 00010000:00010000:0.0:1788390410.136760:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788390410.136762:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788390410.136773:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:13154:x1875263098012544:12345-0@lo:104: Request processed in 108us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1788390410.136774:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390410.136775:0:10310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788390410.136785:0:13154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012800:0@lo:104: 00000100:00100000:0.0:1788390410.136792:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1788390410.136793:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63da00 already unused, calling callback (ffffffffc13bec20) 00000100:00100000:3.0:1788390410.136799:0:10310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098012672 00000100:00100000:3.0:1788390410.136805:0:10310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098012672 10000000:00010000:1.0:1788390410.136806:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.136818:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.136826:0:13154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1788390410.136831:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390410.136832:0:10310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 10000000:01000000:1.0:1788390410.136841:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788390410.136845:0:10310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+3:13154:x1875263098012672:12345-0@lo:104: 00000100:00100000:0.0:1788390410.136847:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098012800 00000100:00100000:0.0:1788390410.136853:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098012800 00010000:00010000:2.0:1788390410.136855:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c8f expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.136857:0:10310:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.136877:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c8f expref: 12 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390410.136878:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788390410.136889:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+4:13154:x1875263098012800:12345-0@lo:104: 00000100:00100000:2.0:1788390410.136894:0:13154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012928:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390410.136900:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.136902:0:10310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788390410.136913:0:10310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+4:13154:x1875263098012672:12345-0@lo:104: Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390410.136919:0:10310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788390410.136933:0:13154:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8900 going to sleep for 11 seconds 00010000:00010000:3.0:1788390410.136942:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788390410.136959:0:13154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012416:0@lo:104: 00010000:00010000:0.0:1788390410.136959:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788390410.136970:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+3:13154:x1875263098012800:12345-0@lo:104: Request processed in 81us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390410.136977:0:13154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b45880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012544:0@lo:104: 00000100:00100000:0.0:1788390410.136981:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788390410.136992:0:13154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012672:0@lo:104: 00000100:00100000:2.0:1788390410.137004:0:13154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012800:0@lo:104: 00010000:00010000:1.0:1788390410.137004:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137017:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390410.137152:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137160:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf63da00/0xe156d0713be976a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be976a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137174:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390410.137178:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.137180:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788390410.137188:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63cc00 already unused, calling callback (ffffffffc13bec20) 00000100:00100000:2.0:1788390410.137196:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098013056:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1788390410.137200:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137209:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390410.137227:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390410.137233:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788390410.137248:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390410.137248:0:13156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390410.137250:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137258:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390410.137277:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390410.137279:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098013184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390410.137290:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf63cc00/0xe156d0713be97685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9768c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137302:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390410.137304:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390410.137305:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390410.137309:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390410.137373:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098013056 00000100:00100000:2.0:1788390410.137391:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098013056 00000100:00100000:1.0:1788390410.137402:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098013184 00000100:00100000:1.0:1788390410.137408:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098013184 00010000:00010000:2.0:1788390410.137415:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be976a1 expref: 25 pid: 6484 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137427:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97685 expref: 25 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.137433:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.137443:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63d000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390410.137447:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.137449:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788390410.137460:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390410.137463:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788390410.137466:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+25:3624:x1875263098013056:12345-0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1788390410.137478:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390410.137483:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+25:3622:x1875263098013184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390410.137486:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:3.0:1788390410.137489:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788390410.137497:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390410.137501:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be976a1 expref: 25 pid: 6484 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137505:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97685 expref: 25 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.137516:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.137518:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be976a1 expref: 25 pid: 6484 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.137536:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390410.137540:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97685 expref: 25 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.137550:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.137560:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf63d000/0xe156d0713be97693 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9769a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.137566:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a81c00/0xe156d0713be976a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be976a1 expref: 25 pid: 6484 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137571:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf63dc00/0xe156d0713be9768c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97685 expref: 25 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.137574:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390410.137578:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390410.137582:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390410.137585:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390410.137589:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390410.137618:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390410.137630:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3624:x1875263098013056:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390410.137631:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098013312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390410.137633:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3622:x1875263098013184:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390410.137647:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788390410.137654:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788390410.137667:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390410.137677:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098013312 00000100:00100000:1.0:1788390410.137682:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098013312 00000100:00100000:2.0:1788390410.137691:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098013056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390410.137698:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97693 expref: 22 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390410.137702:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098013184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390410.137729:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788390410.137735:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+22:3622:x1875263098013312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390410.137742:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390410.137746:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97693 expref: 22 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137751:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97693 expref: 22 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137757:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf63c400/0xe156d0713be9769a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97693 expref: 22 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.137763:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390410.137784:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3622:x1875263098013312:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390410.137790:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390410.137803:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098013312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390410.138992:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390410.138996:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390410.138999:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390410.139020:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390410.139033:0:13154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012288:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390410.139060:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088508160 00000100:00100000:0.0:1788390410.139065:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088508160 00010000:00010000:0.0:1788390410.139086:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cce expref: 13 pid: 6484 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.139091:0:13156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.139111:0:13156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5a00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390410.139115:0:13156:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.139125:0:13156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390410.139133:0:13156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390410.139139:0:13156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788390410.139145:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 43 00000100:00100000:0.0:1788390410.139155:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2405:x1875263088508160:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390410.139167:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390410.139172:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cce expref: 13 pid: 6484 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.139182:0:13156:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.139190:0:13156:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390410.139196:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cce expref: 13 pid: 6484 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390410.139212:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b4e00/0xe156d0713be976bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cce expref: 13 pid: 6484 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390410.139215:0:13156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.139223:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098013440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390410.139227:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5a00/0xe156d0713be97677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9767e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390410.139228:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390410.139255:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390410.139258:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390410.139261:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390410.139274:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:2405:x1875263088508160:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 119us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390410.139283:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390410.139287:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 43 00000100:00100000:0.0:1788390410.139309:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098013440 00000100:00100000:0.0:1788390410.139313:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098013440 00010000:00010000:0.0:1788390410.139361:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97677 expref: 21 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390410.139400:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788390410.139409:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3624:x1875263098013440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390410.139418:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390410.139422:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97677 expref: 21 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390410.139441:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97677 expref: 21 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390410.139452:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf63c200/0xe156d0713be9767e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97677 expref: 21 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390410.139461:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390410.139496:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+20:3624:x1875263098013440:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390410.139502:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390410.139581:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098013440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390410.139881:0:13154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875263098012928:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390410.139910:0:13154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390410.140505:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390410.140558:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088508288 00000100:00100000:2.0:1788390410.140563:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088508288 00010000:00010000:2.0:1788390410.140584:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c8f expref: 12 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.140622:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:2.0:1788390410.140631:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+12:2404:x1875263088508288:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390410.140640:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390410.140645:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c8f expref: 12 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140655:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c8f expref: 12 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140667:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d5c00/0xe156d0713be97670 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c8f expref: 12 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140678:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140685:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140696:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140702:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140708:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140713:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140727:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390410.140731:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140738:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140755:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390410.140764:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390410.140780:0:13154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.140792:0:13154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390410.140800:0:13154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b4a00/0xe156d0713be976e0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390410.140805:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+11:2404:x1875263088508288:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 173us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390410.140819:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 45 00010000:00010000:1.0:1788390410.386440:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390411.284316:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390411.284355:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088508416 00000100:00100000:2.0:1788390411.284363:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088508416 00000100:00100000:2.0:1788390411.284432:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 301 00000100:00100000:2.0:1788390411.284442:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+11:6169:x1875263088508416:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390411.284458:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390411.284478:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243cff expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.284507:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cff expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.284523:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cff expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.284544:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4800, rc 0) 00000100:00100000:2.0:1788390411.284606:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088508416:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 Request processed in 165us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390411.284613:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 301 00000100:00100000:1.0:1788390411.289425:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390411.289718:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088508544 00000100:00100000:0.0:1788390411.289736:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088508544 00000100:00100000:0.0:1788390411.289976:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 302 00000100:00100000:0.0:1788390411.289986:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088508544:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.290132:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088508544:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 Request processed in 147us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390411.290141:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 302 00000100:00100000:0.0:1788390411.293754:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390411.293871:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088508672 00000100:00100000:1.0:1788390411.293881:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088508672 00000100:00100000:1.0:1788390411.293933:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 303 00000100:00100000:1.0:1788390411.293943:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088508672:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390411.294061:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088508672:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390411.294069:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 303 00000100:00100000:1.0:1788390411.297921:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390411.298103:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088508800 00000100:00100000:3.0:1788390411.298112:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088508800 00000100:00100000:3.0:1788390411.298164:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 304 00000100:00100000:3.0:1788390411.298175:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088508800:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390411.298192:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390411.298210:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d06 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390411.298253:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d06 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390411.298264:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d06 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390411.298273:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf734e00, rc 0) 00000100:00100000:3.0:1788390411.298348:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088508800:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 Request processed in 174us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.298356:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 304 00000100:00100000:1.0:1788390411.302885:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390411.302940:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088508928 00000100:00100000:3.0:1788390411.302949:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088508928 00000100:00100000:3.0:1788390411.303112:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 305 00000100:00100000:3.0:1788390411.303124:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088508928:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390411.303275:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088508928:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 Request processed in 152us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.303283:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 305 00000100:00100000:0.0:1788390411.308960:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390411.309094:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088509056 00000100:00100000:3.0:1788390411.309103:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088509056 00000100:00100000:3.0:1788390411.309155:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 306 00000100:00100000:3.0:1788390411.309166:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088509056:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390411.309292:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088509056:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 Request processed in 128us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.309301:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 306 00010000:00010000:3.0:1788390411.409484:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788390411.538393:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390411.538401:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fc18b3800 from 7 10000000:01000000:0.0:1788390411.538407:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390411.538455:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.538467:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.538491:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390411.538523:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098013568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.538592:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390411.538638:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098013568 00000100:00100000:0.0:1788390411.538645:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390411.538646:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098013568 00000100:00100000:2.0:1788390411.538704:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788390411.538715:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263098013568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390411.538728:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390411.538742:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be976f5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.538767:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be976f5 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.538778:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be976f5 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.538789:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:2.0:1788390411.538829:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098013568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390411.538836:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788390411.539003:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098013568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390411.539025:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.539035:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390411.539096:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098013696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.539122:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390411.539144:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390411.539168:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098013696 00000100:00100000:2.0:1788390411.539174:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098013696 00000100:00100000:2.0:1788390411.539209:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788390411.539217:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098013696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390411.539358:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098013696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390411.539377:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788390411.539496:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098013696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.539547:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098013824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.539589:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390411.539617:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390411.539635:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098013824 00000100:00100000:2.0:1788390411.539640:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098013824 00000100:00100000:2.0:1788390411.539669:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788390411.539677:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098013824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390411.539767:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098013824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390411.539775:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788390411.539833:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098013824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788390411.540733:0:13291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788390411.540831:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788390411.540856:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390411.540916:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.540936:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390411.540946:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390411.540949:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fb7b73800 from 7 10000000:01000000:0.0:1788390411.540951:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390411.540975:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.540983:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.541003:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390411.541022:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098013952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.541065:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390411.541103:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390411.541117:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098013952 00000100:00100000:3.0:1788390411.541128:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098013952 00000100:00100000:3.0:1788390411.541173:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788390411.541181:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098013952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390411.541191:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390411.541203:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97703 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390411.541223:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97703 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390411.541234:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97703 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390411.541243:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf734400, rc 0) 00000100:00100000:3.0:1788390411.541284:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098013952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.541291:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788390411.541355:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098013952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390411.541397:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.541408:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390411.541454:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.541477:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390411.541513:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390411.541518:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098014080 00000100:00100000:3.0:1788390411.541524:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098014080 00000100:00100000:3.0:1788390411.541554:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788390411.541562:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098014080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390411.541673:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098014080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.541680:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788390411.541757:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.541786:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.541821:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390411.541839:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390411.541849:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098014208 00000100:00100000:3.0:1788390411.541854:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098014208 00000100:00100000:3.0:1788390411.541881:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788390411.541898:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098014208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.542073:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390411.542102:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098014208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.542110:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000040:00080000:3.0:1788390411.542879:0:13292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788390411.543006:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788390411.543024:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390411.543031:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.543040:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390411.543051:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390411.543053:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fb76a1000 from 7 10000000:01000000:0.0:1788390411.543055:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390411.543074:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.543081:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.543090:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390411.543104:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.543134:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390411.543169:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098014336 00000100:00100000:0.0:1788390411.543170:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb60866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390411.543176:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098014336 00000100:00100000:3.0:1788390411.543213:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788390411.543221:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098014336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390411.543231:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390411.543242:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97711 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390411.543261:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97711 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390411.543271:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97711 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390411.543279:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63c400, rc 0) 00000100:00100000:3.0:1788390411.543340:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098014336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.543348:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788390411.543359:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390411.543386:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.543394:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390411.543436:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390411.543465:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390411.543490:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098014464 00000100:00100000:2.0:1788390411.543492:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390411.543496:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098014464 00000100:00100000:3.0:1788390411.543526:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788390411.543535:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098014464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390411.543614:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098014464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390411.543622:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390411.543634:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788390411.543646:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390411.543675:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390411.543695:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390411.543722:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098014592 00000100:00100000:0.0:1788390411.543727:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098014592 00000100:00100000:0.0:1788390411.543759:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788390411.543766:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098014592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.543841:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098014592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390411.543848:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788390411.543889:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788390411.544551:0:13293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788390411.544668:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788390411.544692:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390411.544698:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.544707:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390411.544715:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390411.544717:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984f988e6800 from 7 10000000:01000000:2.0:1788390411.544720:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390411.544736:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.544744:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.544752:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390411.544765:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390411.544797:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390411.544862:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390411.544895:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098014720 00000100:00100000:0.0:1788390411.544900:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098014720 00000100:00100000:0.0:1788390411.544932:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788390411.544944:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098014720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390411.544951:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390411.544962:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9771f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.544977:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9771f expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.544987:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9771f expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390411.544995:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80200, rc 0) 00000100:00100000:0.0:1788390411.545031:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098014720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390411.545038:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788390411.545045:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390411.545062:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.545073:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390411.545113:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390411.545148:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390411.545166:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390411.545176:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098014848 00000100:00100000:0.0:1788390411.545181:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098014848 00000100:00100000:0.0:1788390411.545210:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788390411.545219:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098014848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.545298:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098014848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390411.545305:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788390411.545313:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390411.545364:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390411.545412:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390411.545438:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098014976 00000100:00100000:2.0:1788390411.545441:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390411.545443:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098014976 00000100:00100000:0.0:1788390411.545480:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788390411.545486:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098014976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390411.545556:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098014976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390411.545563:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788390411.545604:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098014976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788390411.546460:0:13294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788390411.546595:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788390411.546613:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390411.546618:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390411.546625:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390411.857589:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098015104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390411.857661:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098015232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788390411.857675:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390411.857702:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390411.857760:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098015104 00000100:00100000:0.0:1788390411.857768:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098015104 00000100:00080000:1.0:1788390411.857823:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390411.857835:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788390411.857846:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098015104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788390411.857874:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390411.857926:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098015104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390411.857934:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788390411.857972:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098015232 00000100:00100000:0.0:1788390411.857976:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098015232 00000100:00100000:0.0:1788390411.858019:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1788390411.858024:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88039880 x1875263098015104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390411.858044:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098015104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390411.858160:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098015360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390411.858198:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390411.858243:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098015360 00000100:00100000:3.0:1788390411.858248:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098015360 00000100:00100000:3.0:1788390411.858295:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788390411.858304:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098015360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390411.858317:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390411.858395:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098015360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390411.858403:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788390411.858427:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788390411.858454:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e878bce00 x1875263098015360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390411.858485:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098015360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390411.859185:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098015232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788390411.859218:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788390411.859282:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098015232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390411.859291:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788390411.859466:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098015232:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788390411.988900:0:13354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788390412.369526:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263098015488:0@lo:400:kworker.0 00000100:00100000:3.0:1788390412.369528:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098015744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390412.369619:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098015616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390412.369698:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390412.369950:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098015488 00000100:00100000:2.0:1788390412.369958:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098015488 00000100:00100000:2.0:1788390412.370002:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788390412.370012:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263098015488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.370065:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263098015488:12345-0@lo:400:kworker.0 Request processed in 54us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.370072:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788390412.370109:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263098015488:0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.370653:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098015872:0@lo:400:kworker.0 00000100:00100000:0.0:1788390412.370662:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098016128:0@lo:400:kworker.0 00000100:00100000:0.0:1788390412.370689:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390412.370709:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098016640:0@lo:400:kworker.0 00000100:00100000:0.0:1788390412.370729:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390412.370746:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788390412.370751:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098016000:0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.370764:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390412.370774:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390412.370793:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098016384:0@lo:400:kworker.0 00000100:00100000:0.0:1788390412.370796:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098016512:0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.370837:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390412.370856:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788390412.370862:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098016256:0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.370881:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390412.370891:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098016768:0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.370906:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390412.370928:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098015872 00000100:00100000:2.0:1788390412.370932:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098015872 00000100:00100000:2.0:1788390412.370958:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788390412.370965:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098015872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.371003:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098015872:12345-0@lo:400:kworker.0 Request processed in 37us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.371009:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788390412.371024:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098016128 00000100:00100000:2.0:1788390412.371027:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098016128 00000100:00100000:2.0:1788390412.371049:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098016000 00000100:00100000:2.0:1788390412.371051:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098016000 00000100:00100000:2.0:1788390412.371060:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098016384 00000100:00100000:2.0:1788390412.371061:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098016384 00000100:00100000:2.0:1788390412.371071:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098016256 00000100:00100000:2.0:1788390412.371073:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098016256 00000100:00100000:2.0:1788390412.371083:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788390412.371088:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098016128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.371113:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098016128:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.371118:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788390412.371134:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788390412.371139:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098016000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.371164:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098016000:12345-0@lo:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.371169:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788390412.371178:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788390412.371183:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098016384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.371202:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098016384:12345-0@lo:400:kworker.0 Request processed in 19us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.371207:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788390412.371215:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788390412.371219:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098016256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.371248:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098016256:12345-0@lo:400:kworker.0 Request processed in 17us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.371254:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788390412.371269:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098016640 00000100:00100000:2.0:1788390412.371272:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098016640 00000100:00100000:2.0:1788390412.371292:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098016768 00000100:00100000:2.0:1788390412.371294:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098016768 00000100:00100000:2.0:1788390412.371350:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788390412.371368:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098016640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.371397:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098016640:12345-0@lo:400:kworker.0 Request processed in 40us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.371403:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788390412.371414:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390412.371421:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098016768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.371456:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098016768:12345-0@lo:400:kworker.0 Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.371462:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788390412.371486:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390412.371491:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788390412.371493:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788390412.371522:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8803ad80 x1875263098016256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390412.371535:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098016256:0@lo:400:kworker.0 00010000:00080000:2.0:1788390412.371543:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88039880 x1875263098016768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390412.371551:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098016768:0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.371559:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098015872:0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.371566:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098016384:0@lo:400:kworker.0 00000100:00100000:3.0:1788390412.372553:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390412.372696:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390412.372697:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098015744 00000100:00100000:2.0:1788390412.372704:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098015744 00000100:00100000:2.0:1788390412.372741:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098015616 00000100:00100000:2.0:1788390412.372744:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098015616 00000100:00100000:2.0:1788390412.372757:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788390412.372766:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098015744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390412.372772:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390412.372784:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098015616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788390412.372791:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390412.372830:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098015744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.372836:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788390412.372945:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e878bce00 x1875263098015744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390412.372964:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098015744:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390412.373029:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390412.373066:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098015616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 286us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390412.373073:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788390412.373100:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87aa1880 x1875263098015616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390412.373124:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098015616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788390412.376581:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390412.376665:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098016128:0@lo:400:kworker.0 00010000:00080000:0.0:1788390412.376682:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88038a80 x1875263098016640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390412.376692:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098016640:0@lo:400:kworker.0 00000100:00100000:0.0:1788390412.376720:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098016000:0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.377447:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098016512 00000100:00100000:2.0:1788390412.377456:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098016512 00000100:00080000:3.0:1788390412.377532:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788390412.377538:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788390412.377551:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098016512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390412.377636:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098016512:12345-0@lo:400:kworker.0 Request processed in 87us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390412.377644:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:1.0:1788390412.377669:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88039f80 x1875263098016512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390412.377695:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098016512:0@lo:400:kworker.0 00010000:00010000:3.0:1788390412.436129:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390413.457849:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390414.481595:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390414.613484:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390414.613535:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390414.613551:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088509184 00000100:00100000:0.0:1788390414.613566:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088509184 00000100:00100000:1.0:1788390414.613571:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390414.613619:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390414.613649:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 319 00000100:00100000:1.0:1788390414.613651:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390414.613680:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088509440 00000100:00100000:1.0:1788390414.613685:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088509440 00000100:00100000:0.0:1788390414.613692:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088509184:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390414.613733:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088509696 00000100:00100000:3.0:1788390414.613746:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088509696 00000100:00100000:1.0:1788390414.613751:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088509312 00000100:00100000:1.0:1788390414.613756:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088509312 00000100:00100000:3.0:1788390414.613777:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088509568 00000100:00100000:3.0:1788390414.613781:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088509568 00000100:00100000:1.0:1788390414.613789:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 137 00000100:00100000:0.0:1788390414.613801:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088509184:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390414.613803:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088509440:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390414.613809:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 138 00000100:00100000:0.0:1788390414.613821:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 319 00000100:00100000:3.0:1788390414.613827:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088509696:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390414.613852:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088509440:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 54us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390414.613873:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 137 00000100:00100000:3.0:1788390414.613877:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088509696:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 54us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390414.613887:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 138 00000100:00100000:1.0:1788390414.613896:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 139 00000100:00100000:1.0:1788390414.613907:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2407:x1875263088509312:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390414.613908:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 140 00000100:00100000:3.0:1788390414.613921:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088509568:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390414.613946:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2407:x1875263088509312:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390414.613957:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 139 00000100:00100000:3.0:1788390414.613959:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088509568:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390414.613969:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 140 00000100:00080000:1.0:1788390414.613981:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390414.613988:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390414.620750:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390414.620874:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390414.625099:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088509824 00000100:00100000:2.0:1788390414.625122:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088509824 00000100:00080000:1.0:1788390414.625202:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390414.625228:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088509952 00000100:00100000:2.0:1788390414.625233:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088509952 00000100:00100000:2.0:1788390414.625283:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00080000:1.0:1788390414.625287:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390414.625298:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2403:x1875263088509824:12345-192.168.202.11@tcp:9:kworker.0 00000020:00000080:2.0:1788390414.625373:0:8407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be976d2 00000100:00100000:0.0:1788390414.625384:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00080000:2.0:1788390414.625387:0:8407:0:(import.c:65:import_set_state_nolock()) ffff984fc18b4000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788390414.625399:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2403:x1875263088509952:12345-192.168.202.11@tcp:9:kworker.0 00000020:00000080:0.0:1788390414.625416:0:8798:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be976d9 00000100:00080000:0.0:1788390414.625421:0:8798:0:(import.c:65:import_set_state_nolock()) ffff984e877d6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788390414.625458:0:8407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000001:00000004:0.0:1788390414.625462:0:8798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1788390414.625688:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390414.626177:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+2:2403:x1875263088509952:12345-192.168.202.11@tcp:9:kworker.0 Request processed in 779us (5299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390414.626186:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 23 00010000:00010000:0.0:1788390414.626215:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390414.626219:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+2:2403:x1875263088509824:12345-192.168.202.11@tcp:9:kworker.0 Request processed in 923us (5481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390414.626231:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:2.0:1788390414.929874:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098016896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390414.929977:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390414.930135:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098016896 00000100:00100000:3.0:1788390414.930146:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098016896 00000100:00100000:3.0:1788390414.930209:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788390414.930221:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098016896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788390414.930485:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788390414.930558:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098016896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 338us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390414.930566:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788390414.931468:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098016896:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788390415.446380:0:13503:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:06:54 (1788390414) === 00010000:00010000:1.0:1788390415.507033:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390415.573614:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.573669:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088510080 00000100:00100000:2.0:1788390415.573679:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088510080 00000100:00100000:2.0:1788390415.573729:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:2.0:1788390415.573741:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:10507:x1875263088510080:12345-192.168.202.11@tcp:700:mkdir.0 00000100:00100000:2.0:1788390415.573832:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:10507:x1875263088510080:12345-192.168.202.11@tcp:700:mkdir.0 Request processed in 93us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390415.573841:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:1.0:1788390415.574918:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.575070:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088510336 00000100:00100000:2.0:1788390415.575077:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088510336 00000100:00100000:2.0:1788390415.575164:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:2.0:1788390415.575173:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:10507:x1875263088510336:12345-192.168.202.11@tcp:36:mkdir.0 00010000:00010000:2.0:1788390415.575221:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390415.575247:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be975cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c7a expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.575269:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7866500) 00010000:00010000:2.0:1788390415.575280:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390415.575400:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.575414:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.575424:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.575436:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.575442:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.575449:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576357:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576368:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576377:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390415.576395:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af2f73c0 reply state 00000000e4003d12 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576406:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576412:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984f8c933700) 00010000:00010000:2.0:1788390415.576415:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390415.576418:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788390415.576423:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788390415.576430:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576437:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576444:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576450:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390415.576455:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576473:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576483:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933b00) 00010000:00010000:2.0:1788390415.576485:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390415.576489:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576495:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9772d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390415.576510:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af2f73c0 reply state 00000000e4003d12 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576517:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.576523:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984f8c933500) 00010000:00010000:2.0:1788390415.576526:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390415.576528:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788390415.576620:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:10507:x1875263088510336:12345-192.168.202.11@tcp:36:mkdir.0 Request processed in 1447us (1704us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788390415.576628:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:1.0:1788390415.582128:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.582209:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088510464 00000100:00100000:2.0:1788390415.582220:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088510464 00000100:00100000:2.0:1788390415.582280:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00100000:2.0:1788390415.582290:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:10508:x1875263088510464:12345-192.168.202.11@tcp:101:chmod.0 00010000:00010000:2.0:1788390415.582311:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390415.583395:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97742 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d0d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.583469:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be97749 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.583479:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be97749 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.583487:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be97749 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390415.583520:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788390415.583523:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390415.583550:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be97749 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.583568:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97742 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d0d expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.583581:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be97749 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d0d expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.583587:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:2.0:1788390415.583589:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390415.583592:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4e00, rc 0) 00000100:00100000:2.0:1788390415.583642:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:10508:x1875263088510464:12345-192.168.202.11@tcp:101:chmod.0 Request processed in 1354us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390415.583649:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00100000:0.0:1788390415.585238:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.585288:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088510720 00000100:00100000:2.0:1788390415.585298:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088510720 00000100:00100000:2.0:1788390415.585398:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:2.0:1788390415.585407:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:10508:x1875263088510720:12345-192.168.202.11@tcp:36:chmod.0 00010000:00010000:2.0:1788390415.585461:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390415.585486:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be97749 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d0d expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.585505:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:2.0:1788390415.585515:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390415.585539:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.585550:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.585559:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390415.585756:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c25c7910 reply state 00000000393be0b2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.585769:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.585775:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933000) 00010000:00010000:2.0:1788390415.585778:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788390415.585781:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788390415.585786:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788390415.585852:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:10508:x1875263088510720:12345-192.168.202.11@tcp:36:chmod.0 Request processed in 446us (617us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788390415.585860:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:1.0:1788390415.598128:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.598225:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088510848 00000100:00100000:2.0:1788390415.598234:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088510848 00000100:00100000:2.0:1788390415.598294:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:2.0:1788390415.598306:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:10509:x1875263088510848:12345-192.168.202.11@tcp:101:chown.0 00010000:00010000:2.0:1788390415.598454:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390415.598474:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be97757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d14 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.598546:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be9775e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.598563:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be9775e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.598576:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be9775e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390415.598628:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788390415.598632:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390415.598699:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be9775e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.598730:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be97757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d14 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.598745:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be9775e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d14 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.598752:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933000) 00010000:00010000:2.0:1788390415.598755:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390415.598765:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5a00, rc 0) 00000100:00100000:2.0:1788390415.598829:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:10509:x1875263088510848:12345-192.168.202.11@tcp:101:chown.0 Request processed in 525us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390415.598836:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:1.0:1788390415.600714:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.600919:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088510976 00000100:00100000:2.0:1788390415.600928:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088510976 00000100:00100000:2.0:1788390415.601093:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 26 00000100:00100000:2.0:1788390415.601104:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:10509:x1875263088510976:12345-192.168.202.11@tcp:101:chown.0 00010000:00010000:2.0:1788390415.601125:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390415.601142:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d1b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601202:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601214:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601226:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601237:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601245:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601251:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601361:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9777a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601382:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9777a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601389:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9777a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390415.601424:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788390415.601427:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390415.601443:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9777a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601455:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601462:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601469:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601475:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390415.601480:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601488:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601500:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933000) 00010000:00010000:2.0:1788390415.601503:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390415.601508:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601525:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9776c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601539:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601545:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601551:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601557:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390415.601560:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601566:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601574:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984f8c933500) 00010000:00010000:2.0:1788390415.601577:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390415.601580:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601586:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97773 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601612:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d1b expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601625:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9777a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d1b expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.601639:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984f8c933700) 00010000:00010000:2.0:1788390415.601642:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390415.601644:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4600, rc 0) 00000100:00100000:2.0:1788390415.601700:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:10509:x1875263088510976:12345-192.168.202.11@tcp:101:chown.0 Request processed in 596us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390415.601707:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 26 00000100:00100000:3.0:1788390415.603839:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390415.603882:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088511104 00000100:00100000:3.0:1788390415.603892:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088511104 00000100:00100000:3.0:1788390415.603951:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:3.0:1788390415.603964:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:10509:x1875263088511104:12345-192.168.202.11@tcp:900:chown.0 00000100:00100000:3.0:1788390415.604045:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:10509:x1875263088511104:12345-192.168.202.11@tcp:900:chown.0 Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390415.604056:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:1.0:1788390415.608759:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390415.608857:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088511360 00000100:00100000:3.0:1788390415.608868:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088511360 00000100:00100000:3.0:1788390415.608925:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 27 00000100:00100000:3.0:1788390415.608936:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:10509:x1875263088511360:12345-192.168.202.11@tcp:36:chown.0 00010000:00010000:3.0:1788390415.608990:0:8996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390415.609015:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9777a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d1b expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.609030:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984f8c933700) 00010000:00010000:3.0:1788390415.609042:0:8996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390415.609061:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.609071:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.609077:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390415.610452:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1788390415.610530:0:8996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039beccad reply state 000000002a1d9f3a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610544:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.610549:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610562:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.610565:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984f8c933700) 00010000:00010000:0.0:1788390415.610573:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.610578:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788390415.610585:0:8996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788390415.610586:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390415.610593:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390415.610597:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788390415.610611:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610627:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984f8c933500) 00010000:00010000:0.0:1788390415.610631:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390415.610635:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610642:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97734 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610663:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610671:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610677:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610683:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390415.610687:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610693:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788390415.610702:0:8996:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1788390415.610703:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984f8c933700) 00010000:00010000:0.0:1788390415.610707:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390415.610710:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390415.610726:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:10509:x1875263088511360:12345-192.168.202.11@tcp:36:chown.0 Request processed in 1788us (1972us total) trans 4294967301 rc 0/0 00010000:00010000:0.0:1788390415.610731:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be9773b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390415.610739:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 27 00010000:00010000:0.0:1788390415.610750:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610758:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610765:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610770:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390415.610774:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610780:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610789:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933000) 00010000:00010000:0.0:1788390415.610792:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788390415.610795:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.610801:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be97750 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.610866:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.610874:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.610879:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.610885:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63dc00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390415.610888:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.610894:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.610903:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984f8c933700) 00010000:00010000:2.0:1788390415.610905:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788390415.610908:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.610913:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97781 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390415.622474:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.623629:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088511488 00000100:00100000:2.0:1788390415.623642:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088511488 00000100:00100000:2.0:1788390415.623745:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:2.0:1788390415.623757:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:10510:x1875263088511488:12345-192.168.202.11@tcp:101:touch.500 00010000:00010000:2.0:1788390415.623786:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390415.623819:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788390415.624792:0:6494:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 919us 00010000:00010000:1.0:1788390415.634673:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634695:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634709:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634724:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634730:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634736:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634866:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5c00/0xe156d0713be9779d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634875:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5c00/0xe156d0713be9779d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634893:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5c00/0xe156d0713be9779d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390415.634926:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788390415.634930:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390415.634976:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5c00/0xe156d0713be9779d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634986:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634991:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.634995:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635000:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390415.635003:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635008:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635018:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933000) 00010000:00010000:1.0:1788390415.635021:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390415.635024:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635029:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9778f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635047:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635051:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635054:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635057:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390415.635059:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635063:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635069:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984fb785f700) 00010000:00010000:1.0:1788390415.635070:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390415.635072:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635075:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97796 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635105:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d22 expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635115:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5c00/0xe156d0713be9779d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d22 expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.635127:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390415.635129:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788390415.635131:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5c00, rc 0) 00000100:00100000:1.0:1788390415.635195:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:10510:x1875263088511488:12345-192.168.202.11@tcp:101:touch.500 Request processed in 11441us (12731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390415.635202:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:1.0:1788390415.640895:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.640940:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088511744 00000100:00100000:2.0:1788390415.640950:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088511744 00000100:00100000:2.0:1788390415.641031:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00100000:2.0:1788390415.641040:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:10510:x1875263088511744:12345-192.168.202.11@tcp:101:touch.500 00010000:00010000:2.0:1788390415.641059:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390415.641076:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be977a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641167:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641183:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641196:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641267:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641292:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641300:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390415.641760:0:6493:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788390415.641902:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be977b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641912:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be977b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641920:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be977b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641949:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641956:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641962:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641968:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390415.641972:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.641980:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.642002:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984fb785f900) 00010000:00010000:2.0:1788390415.642005:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390415.642009:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.642015:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390415.642027:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088cdc89f reply state 000000003c11a7be transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.642037:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.642043:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff984e86840f00) 00010000:00010000:2.0:1788390415.642046:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390415.642048:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788390415.642076:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be977a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d29 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.642091:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be977b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d29 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.642097:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff984e86840000) 00010000:00010000:2.0:1788390415.642099:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390415.642101:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4400, rc 0) 00000100:00100000:2.0:1788390415.642167:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:10510:x1875263088511744:12345-192.168.202.11@tcp:101:touch.500 Request processed in 1127us (1281us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788390415.642174:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00100000:2.0:1788390415.648438:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390415.648622:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088512000 00000100:00100000:3.0:1788390415.648632:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088512000 00000100:00100000:3.0:1788390415.648691:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 30 00000100:00100000:3.0:1788390415.648704:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:10510:x1875263088512000:12345-192.168.202.11@tcp:36:touch.500 00010000:00010000:3.0:1788390415.648759:0:8996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390415.648785:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be977b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d29 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.648803:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff984e86840000) 00010000:00010000:3.0:1788390415.648814:0:8996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390415.648870:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.648883:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.648892:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390415.648988:0:8996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b236eedf reply state 0000000018d250d6 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.649000:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390415.649016:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:3.0:1788390415.649019:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390415.649021:0:8996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390415.649120:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:10510:x1875263088512000:12345-192.168.202.11@tcp:36:touch.500 Request processed in 419us (690us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788390415.649128:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 30 00000100:00100000:1.0:1788390415.650732:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.650779:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088512128 00000100:00100000:2.0:1788390415.650787:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088512128 00000100:00100000:2.0:1788390415.650876:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:2.0:1788390415.650887:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:10510:x1875263088512128:12345-192.168.202.11@tcp:101:touch.500 00010000:00010000:2.0:1788390415.650906:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390415.650922:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be977ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.650966:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be977ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d30 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.650978:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be977ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d30 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.650993:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:2.0:1788390415.650996:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390415.650999:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5400, rc 0) 00000100:00100000:2.0:1788390415.651051:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+12:10510:x1875263088512128:12345-192.168.202.11@tcp:101:touch.500 Request processed in 166us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390415.651058:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:1.0:1788390415.653016:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390415.653127:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088512256 00000100:00100000:0.0:1788390415.653137:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088512256 00000100:00100000:0.0:1788390415.653207:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:0.0:1788390415.653229:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875263088512256:12345-192.168.202.11@tcp:8:touch.500 00010000:00080000:0.0:1788390415.653258:0:8798:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:0.0:1788390415.653291:0:8798:0:(genops.c:1385:class_connect()) connect: client 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa, cookie 0xe156d0713be977d5 00002000:00100000:0.0:1788390415.653302:0:8798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa/ffff984e878f2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390415.653358:0:8798:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390415.653441:0:8798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788390415.653468:0:8798:0:(import.c:65:import_set_state_nolock()) ffff984e878f4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390415.653680:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2403:x1875263088512256:12345-192.168.202.11@tcp:8:touch.500 Request processed in 450us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390415.653688:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:1.0:1788390415.655022:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.655111:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088512384 00000100:00100000:2.0:1788390415.655119:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088512384 00000100:00100000:2.0:1788390415.655213:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:2.0:1788390415.655223:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:0:x1875263088512384:12345-192.168.202.11@tcp:2:touch.500 00000100:00080000:1.0:1788390415.659570:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788390415.662662:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1788390415.662674:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000001:00100000:0.0:1788390415.662678:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000020:00000080:0.0:1788390415.662680:0:8402:0:(genops.c:885:class_export_put()) final put ffff984fc18b0000/ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000100:00100000:2.0:1788390415.662836:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:0:x1875263088512384:12345-192.168.202.11@tcp:2:touch.500 Request processed in 7611us (7814us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788390415.662855:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 25 00000020:00000080:3.0:1788390415.662893:0:480:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc18b0000/ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 for lustre-OST0000 00000020:00000080:3.0:1788390415.662945:0:480:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc18b4000 for lustre-OST0000 00000100:00100000:0.0:1788390415.664863:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390415.664911:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088512640 00000100:00100000:3.0:1788390415.664922:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088512640 00000100:00100000:3.0:1788390415.664984:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:3.0:1788390415.664996:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+12:10510:x1875263088512640:12345-192.168.202.11@tcp:35:touch.500 00000100:00100000:3.0:1788390415.665266:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+13:10510:x1875263088512640:12345-192.168.202.11@tcp:35:touch.500 Request processed in 271us (407us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788390415.665275:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:1.0:1788390415.674188:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.674388:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088512768 00000100:00100000:2.0:1788390415.674398:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088512768 00000100:00100000:2.0:1788390415.674464:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 32 00000100:00100000:2.0:1788390415.674476:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+13:10511:x1875263088512768:12345-192.168.202.11@tcp:101:rm.0 00010000:00010000:2.0:1788390415.674501:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390415.674521:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.674591:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be977e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.674606:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be977e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.674617:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be977e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390415.674657:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788390415.674662:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390415.674701:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be977e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.674728:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d37 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.674746:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be977e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d37 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.674773:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984fb785f900) 00010000:00010000:2.0:1788390415.674777:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390415.674781:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5600, rc 0) 00000100:00100000:2.0:1788390415.674845:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:10511:x1875263088512768:12345-192.168.202.11@tcp:101:rm.0 Request processed in 371us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390415.674852:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 32 00000100:00100000:1.0:1788390415.680212:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390415.680375:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088513024 00000100:00100000:0.0:1788390415.680385:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088513024 00000100:00100000:0.0:1788390415.680510:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:0.0:1788390415.680521:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:10511:x1875263088513024:12345-192.168.202.11@tcp:101:rm.0 00010000:00010000:0.0:1788390415.680542:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390415.680560:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be977ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390415.680670:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788390415.680770:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be977ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d3e expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.680784:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933000) 00010000:00010000:0.0:1788390415.680788:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390415.680805:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be977ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d3e expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.680818:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81400, rc 0) 00000100:00100000:0.0:1788390415.680877:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:10511:x1875263088513024:12345-192.168.202.11@tcp:101:rm.0 Request processed in 358us (673us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1788390415.680884:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:0.0:1788390415.686881:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390415.686989:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088513152 00000100:00100000:3.0:1788390415.687209:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088513152 00000100:00100000:3.0:1788390415.687273:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:3.0:1788390415.687284:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:10511:x1875263088513152:12345-192.168.202.11@tcp:37:rm.0 00000100:00100000:3.0:1788390415.690464:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:10511:x1875263088513152:12345-192.168.202.11@tcp:37:rm.0 Request processed in 3171us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390415.690477:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:1.0:1788390415.693243:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.693431:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088513408 00000100:00100000:2.0:1788390415.693441:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088513408 00000100:00100000:2.0:1788390415.693508:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 4 00000100:00100000:2.0:1788390415.693518:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:10511:x1875263088513408:12345-192.168.202.11@tcp:35:rm.0 00000100:00100000:2.0:1788390415.693739:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:10511:x1875263088513408:12345-192.168.202.11@tcp:35:rm.0 Request processed in 222us (505us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788390415.693746:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 4 00000100:00100000:0.0:1788390415.695394:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.695495:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088513664 00000100:00100000:2.0:1788390415.695502:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088513664 00000100:00100000:2.0:1788390415.695546:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 34 00000100:00100000:2.0:1788390415.695556:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:10511:x1875263088513664:12345-192.168.202.11@tcp:101:rm.0 00010000:00010000:2.0:1788390415.695574:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390415.695594:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d45 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.695697:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be977ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.695708:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be977ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.695721:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be977ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390415.695730:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788390415.695797:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be977f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d45 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.695809:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be977ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d45 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.695815:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984fb785f900) 00010000:00010000:2.0:1788390415.695817:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390415.695820:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4a00, rc 0) 00000100:00100000:2.0:1788390415.695870:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:10511:x1875263088513664:12345-192.168.202.11@tcp:101:rm.0 Request processed in 315us (480us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788390415.695877:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 34 00000100:00100000:1.0:1788390415.697951:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.697994:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088513792 00000100:00100000:2.0:1788390415.698004:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088513792 00000100:00100000:2.0:1788390415.698047:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:2.0:1788390415.698056:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:10511:x1875263088513792:12345-192.168.202.11@tcp:41:rm.0 00000004:00000024:2.0:1788390415.698104:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1788390415.698154:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:10511:x1875263088513792:12345-192.168.202.11@tcp:41:rm.0 Request processed in 99us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390415.698161:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:1.0:1788390415.699437:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390415.699694:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088513920 00000100:00100000:0.0:1788390415.699702:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088513920 00000100:00100000:0.0:1788390415.699745:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 36 00000100:00100000:0.0:1788390415.699754:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:10511:x1875263088513920:12345-192.168.202.11@tcp:101:rm.0 00010000:00010000:0.0:1788390415.699767:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390415.699784:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9780d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.699844:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.699859:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.699869:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.699881:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.699888:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.699910:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.699988:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.699994:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.699999:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390415.700026:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788390415.700029:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390415.700040:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700049:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700054:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700059:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700063:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700066:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390415.700069:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700079:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700088:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390415.700090:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390415.700093:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700096:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97814 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700106:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700109:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700113:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700116:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390415.700117:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700120:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700124:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff984e86840f00) 00010000:00010000:0.0:1788390415.700125:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390415.700126:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700136:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9781b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700153:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9780d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d4c expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700160:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d4c expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390415.700165:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:0.0:1788390415.700167:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390415.700168:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81c00, rc 0) 00000100:00100000:0.0:1788390415.700241:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:10511:x1875263088513920:12345-192.168.202.11@tcp:101:rm.0 Request processed in 489us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390415.700246:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 36 00000100:00100000:0.0:1788390415.702180:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.702889:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088514176 00000100:00100000:2.0:1788390415.702898:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088514176 00000100:00100000:2.0:1788390415.702997:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 37 00000100:00100000:2.0:1788390415.703006:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:10511:x1875263088514176:12345-192.168.202.11@tcp:36:rm.0 00010000:00010000:2.0:1788390415.703054:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788390415.703075:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97822 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d4c expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703091:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be977ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d30 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703100:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:2.0:1788390415.703106:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5600/0xe156d0713be977e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d37 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703111:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984fb785f900) 00010000:00010000:2.0:1788390415.703114:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390415.703130:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703139:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703145:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703151:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703155:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703166:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703236:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703242:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703246:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390415.703462:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788390415.703471:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 236261149332ns, next at 237261147444ns, rc = 0 00010000:00010000:2.0:1788390415.703513:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703522:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703529:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703536:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703543:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703548:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703574:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390415.703588:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703592:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703595:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703599:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390415.703602:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703606:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703612:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:2.0:1788390415.703613:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788390415.703616:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703620:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97837 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703628:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703632:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703635:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703642:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390415.703644:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703647:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703652:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984fb785f900) 00010000:00010000:2.0:1788390415.703653:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390415.703664:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703669:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97829 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390415.703679:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086d14728 reply state 0000000091848aa5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703690:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.703696:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff984e86840f00) 00010000:00010000:2.0:1788390415.703699:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390415.703701:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390415.703769:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:10511:x1875263088514176:12345-192.168.202.11@tcp:36:rm.0 Request processed in 764us (1602us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788390415.703774:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 37 00010000:00010000:1.0:1788390415.703827:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390415.703833:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.703839:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735000 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390415.703843:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.703859:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.703868:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:1.0:1788390415.703871:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788390415.703874:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.703879:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be9783e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390415.703888:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390415.703889:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390415.703890:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390415.707451:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390415.707520:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088514432 00000100:00100000:3.0:1788390415.707530:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088514432 00000100:00100000:3.0:1788390415.707579:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:3.0:1788390415.707588:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:10511:x1875263088514432:12345-192.168.202.11@tcp:35:rm.0 00000100:00100000:3.0:1788390415.707799:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:10511:x1875263088514432:12345-192.168.202.11@tcp:35:rm.0 Request processed in 211us (357us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788390415.707807:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:3.0:1788390415.709640:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390415.709774:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088514688 00000100:00100000:2.0:1788390415.709782:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088514688 00000100:00100000:2.0:1788390415.709866:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 38 00000100:00100000:2.0:1788390415.709886:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:10511:x1875263088514688:12345-192.168.202.11@tcp:36:rm.0 00010000:00010000:2.0:1788390415.709932:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788390415.709956:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be977ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d45 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.709985:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5c00/0xe156d0713be9779d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d22 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.709995:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984fb785f900) 00010000:00010000:2.0:1788390415.710015:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be9775e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d14 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710023:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933000) 00010000:00010000:2.0:1788390415.710028:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390415.710049:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710061:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710070:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710080:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710086:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710091:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710171:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710178:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710184:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390415.710422:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788390415.710435:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710443:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710449:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710455:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390415.710460:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710467:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710476:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff984e86840200) 00010000:00010000:2.0:1788390415.710479:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788390415.710482:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710498:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97853 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710516:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710523:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710528:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710534:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390415.710537:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710543:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710551:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984e86840c00) 00010000:00010000:2.0:1788390415.710553:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390415.710556:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710561:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97845 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390415.710571:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb2e0a98 reply state 000000006363cc86 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710581:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390415.710591:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984e86840800) 00010000:00010000:2.0:1788390415.710593:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390415.710596:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390415.710657:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:10511:x1875263088514688:12345-192.168.202.11@tcp:36:rm.0 Request processed in 771us (1021us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788390415.710664:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 38 00010000:00010000:1.0:1788390416.531609:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390416.977777:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390416.978568:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098017024:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1788390416.978638:0:8794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 237536315425ns, next at 238536312290ns, rc = 0 00000100:00100000:2.0:1788390416.978658:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390416.978665:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390416.978669:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098017152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390416.978708:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390416.978743:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098017024 00000100:00100000:3.0:1788390416.978750:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098017024 00000100:00100000:2.0:1788390416.978762:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098017152 00000100:00100000:2.0:1788390416.978767:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098017152 00000100:00100000:3.0:1788390416.978823:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788390416.978833:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098017024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390416.978856:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390416.978902:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098017024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390416.978909:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788390416.978951:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390416.978958:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098017152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390416.978969:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390416.978997:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098017152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390416.979004:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788390416.980452:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788390416.980501:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8803ad80 x1875263098017024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390416.980526:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098017024:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788390416.980572:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87aa3b80 x1875263098017152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390416.980586:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098017152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390416.982661:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098017280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788390416.982729:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390416.983382:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098017280 00000100:00100000:1.0:1788390416.983394:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098017280 00000100:00100000:1.0:1788390416.983452:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788390416.983464:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098017280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788390416.983501:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788390416.983564:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098017280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390416.983572:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788390416.983610:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098017280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390417.490168:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263098017536:0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.490243:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390417.490296:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263098017920:0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.490356:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390417.490368:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098017536 00000100:00100000:0.0:1788390417.490378:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098017536 00000100:00100000:1.0:1788390417.490399:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390417.490408:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098017792:0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.490436:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788390417.490452:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390417.490452:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3623:x1875263098017536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.490495:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098017920 00000100:00100000:1.0:1788390417.490500:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098017920 00000100:00100000:0.0:1788390417.490515:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3623:x1875263098017536:12345-0@lo:400:kworker.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390417.490534:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788390417.490535:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788390417.490547:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263098017920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.490610:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263098017536:0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.490657:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390417.490667:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098018304:0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.490700:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390417.490722:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098018432:0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.490745:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390417.490760:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098018944:0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.490788:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390417.490808:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390417.490813:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263098018816:0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.490833:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390417.491208:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098017408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390417.491243:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390417.491265:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098018048:0@lo:400:kworker.0 00000100:00100000:2.0:1788390417.491286:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390417.491401:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263098017920:12345-0@lo:400:kworker.0 Request processed in 856us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390417.491408:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788390417.491584:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263098017920:0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.491616:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098018432 00000100:00100000:0.0:1788390417.491620:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098018432 00000100:00100000:0.0:1788390417.491650:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098018944 00000100:00100000:0.0:1788390417.491653:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098018944 00000100:00100000:0.0:1788390417.491678:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788390417.491685:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098018432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.491723:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098018432:12345-0@lo:400:kworker.0 Request processed in 38us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390417.491729:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788390417.492270:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788390417.492279:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098018944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.492367:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098018944:12345-0@lo:400:kworker.0 Request processed in 90us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390417.492373:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788390417.492406:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb2ab800 x1875263098018432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390417.492418:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098018432:0@lo:400:kworker.0 00010000:00080000:0.0:1788390417.492429:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88068a80 x1875263098018944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390417.492437:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098018944:0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.492511:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098018304 00000100:00100000:0.0:1788390417.492515:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098018304 00000100:00100000:1.0:1788390417.492523:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098018816 00000100:00100000:1.0:1788390417.492529:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098018816 00000100:00100000:0.0:1788390417.492564:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788390417.492574:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788390417.492576:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098018304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.492587:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875263098018816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.492624:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098018304:12345-0@lo:400:kworker.0 Request processed in 51us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390417.492632:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788390417.492639:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875263098018816:12345-0@lo:400:kworker.0 Request processed in 55us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390417.492647:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788390417.492686:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263098017664:0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.492716:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390417.492738:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098018176:0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.492760:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390417.492775:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263098018688:0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.492795:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390417.492808:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098019200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390417.492827:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390417.492855:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098017408 00000100:00100000:1.0:1788390417.492867:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098017408 00000100:00100000:1.0:1788390417.492897:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098019200 00000100:00100000:1.0:1788390417.492900:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098019200 00000100:00100000:1.0:1788390417.492914:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788390417.492920:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098017408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390417.492943:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390417.493237:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098017408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390417.493248:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788390417.493264:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390417.493270:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098019200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788390417.493281:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390417.493339:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098019200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390417.493345:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390417.493361:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098017664 00000100:00100000:1.0:1788390417.493365:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098017664 00000100:00100000:1.0:1788390417.493379:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098018176 00000100:00100000:1.0:1788390417.493381:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098018176 00000100:00100000:1.0:1788390417.493392:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098018688 00000100:00100000:1.0:1788390417.493394:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098018688 00000100:00100000:1.0:1788390417.493406:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788390417.493411:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263098017664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.493443:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263098017664:12345-0@lo:400:kworker.0 Request processed in 32us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390417.493450:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788390417.493461:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788390417.493467:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098018176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.493501:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098018176:12345-0@lo:400:kworker.0 Request processed in 35us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390417.493507:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788390417.493519:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788390417.493526:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263098018688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.493567:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263098018688:12345-0@lo:400:kworker.0 Request processed in 42us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390417.493573:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788390417.493605:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263098017664:0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.493616:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098018176:0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.493623:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263098018688:0@lo:400:kworker.0 00010000:00080000:1.0:1788390417.493633:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e868c7480 x1875263098019200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390417.493647:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098019200:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788390417.493696:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88068e00 x1875263098018816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390417.493705:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263098018816:0@lo:400:kworker.0 00010000:00080000:1.0:1788390417.493717:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e878bce00 x1875263098018304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390417.493724:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098018304:0@lo:400:kworker.0 00000100:00080000:1.0:1788390417.493762:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390417.493766:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390417.493774:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390417.500412:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098018560:0@lo:400:kworker.0 00000100:00100000:2.0:1788390417.500494:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390417.500610:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098019072:0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.500666:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098017792 00000100:00100000:3.0:1788390417.500667:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098018048 00000100:00100000:0.0:1788390417.500677:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098017792 00000100:00100000:3.0:1788390417.500678:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098018048 00000100:00100000:3.0:1788390417.500743:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788390417.500752:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098018048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390417.500808:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098018048:12345-0@lo:400:kworker.0 Request processed in 58us (9521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390417.501148:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788390417.501182:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390417.501375:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788390417.501385:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098017792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.501432:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098017792:12345-0@lo:400:kworker.0 Request processed in 49us (10983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390417.501437:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788390417.501604:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098017792:0@lo:400:kworker.0 00010000:00080000:2.0:1788390417.502111:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8803ad80 x1875263098017408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390417.502129:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098017408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390417.502141:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098018048:0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.502290:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098018560 00000100:00100000:0.0:1788390417.502290:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098019072 00000100:00100000:1.0:1788390417.502296:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098018560 00000100:00100000:0.0:1788390417.502301:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098019072 00000100:00100000:1.0:1788390417.502357:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788390417.502365:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098018560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390417.502402:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390417.502409:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098019072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390417.502411:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098018560:12345-0@lo:400:kworker.0 Request processed in 48us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390417.502418:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788390417.502443:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098019072:12345-0@lo:400:kworker.0 Request processed in 35us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390417.502503:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788390417.502545:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb2a9880 x1875263098018560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390417.502560:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098018560:0@lo:400:kworker.0 00010000:00080000:2.0:1788390417.502568:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741b800 x1875263098019072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390417.502575:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098019072:0@lo:400:kworker.0 00010000:00010000:0.0:1788390417.556373:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390417.954662:0:13650:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788390418.577435:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390418.626358:0:13698:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf808f660 20000000:00000080:3.0:1788390418.626375:0:13698:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984e88085800 uarg=0000000000000000 20000000:01000000:3.0:1788390418.626418:0:13698:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788390418.626425:0:13698:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788390418.626431:0:13698:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788390418.627925:0:13699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788390418.628166:0:13698:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788390418.634447:0:13698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788390418.634485:0:13698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788390418.634504:0:13698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788390418.634522:0:13698:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788390418.634542:0:13698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634562:0:13698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cff expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634571:0:13698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d06 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634580:0:13698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be976f5 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634587:0:13698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97703 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634594:0:13698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97711 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634600:0:13698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9771f expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634617:0:13698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634728:0:13698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be9771f expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634744:0:13698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be9771f expref: 23 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390418.634758:0:13698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019328:0@lo:104: 00000100:00100000:3.0:1788390418.634893:0:13698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390418.634951:0:13698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97711 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.634960:0:13698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97711 expref: 23 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390418.634969:0:13698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019456:0@lo:104: 00010000:00010000:3.0:1788390418.634997:0:13698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be97703 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.635004:0:13698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be97703 expref: 23 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390418.635012:0:13698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019584:0@lo:104: 00000100:00100000:0.0:1788390418.635024:0:6475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788390418.635032:0:13698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be976f5 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.635040:0:13698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be976f5 expref: 23 pid: 6487 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.635041:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390418.635053:0:13698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019712:0@lo:104: 00000100:00100000:0.0:1788390418.635069:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390418.635093:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098019328 00000100:00100000:0.0:1788390418.635100:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098019328 00000100:00100000:1.0:1788390418.635107:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098019456 00000100:00100000:1.0:1788390418.635111:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098019456 00000100:00100000:2.0:1788390418.635123:0:10310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098019584 00000100:00100000:2.0:1788390418.635128:0:10310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098019584 00000100:00100000:0.0:1788390418.635141:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390418.635169:0:13698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390418.635191:0:13698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d06 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.635201:0:13698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d06 expref: 12 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390418.635211:0:13698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019840:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390418.635278:0:13698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cff expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.635286:0:13698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cff expref: 12 pid: 6486 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390418.635294:0:13698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88164700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019968:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390418.635365:0:13698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390418.635414:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390418.636797:0:10310:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:2.0:1788390418.636808:0:10310:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:3.0:1788390418.637441:0:10310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098019712 00000100:00100000:3.0:1788390418.637450:0:10310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098019712 00000100:00100000:2.0:1788390418.637735:0:13700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788390418.638494:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+6:13698:x1875263098019456:12345-0@lo:104: 00010000:00010000:0.0:1788390418.638515:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.638607:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390418.638613:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+6:13698:x1875263098019456:12345-0@lo:104: Request processed in 3464us (3571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390418.638632:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1788390418.638795:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390418.638807:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.638817:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81600 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390418.638821:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.638843:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390418.638850:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390418.638855:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390418.638896:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.638903:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390418.638924:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.638931:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be97711 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97718 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.638944:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390418.638946:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390418.638948:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390418.638961:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098020096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390418.639004:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390418.639053:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098020096 00000100:00100000:0.0:1788390418.639058:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098020096 00010000:00010000:0.0:1788390418.639080:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97711 expref: 24 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.639104:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390418.639111:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098020096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390418.639129:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390418.639134:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97711 expref: 24 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.639142:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97711 expref: 24 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.639159:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390418.639185:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098020096:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390418.639192:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390418.639233:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098020096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390418.639291:0:13698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf63c400/0xe156d0713be97718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97711 expref: 23 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.639314:0:13698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019456:0@lo:104: 00000100:00100000:1.0:1788390418.639702:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87967450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+5:13698:x1875263098019328:12345-0@lo:104: 00010000:00010000:1.0:1788390418.639714:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390418.639772:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390418.639778:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87967450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13bece9d-37f8-46e7-9f27-a320529bc20d+5:13698:x1875263098019328:12345-0@lo:104: Request processed in 4357us (4885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390418.639786:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788390418.640005:0:13698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019328:0@lo:104: 00000100:00100000:2.0:1788390418.640248:0:13700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+4:13698:x1875263098019584:12345-0@lo:104: 00010000:00010000:2.0:1788390418.640260:0:13700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390418.640267:0:10310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788390418.640281:0:10310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+4:13698:x1875263098019712:12345-0@lo:104: 00010000:00010000:3.0:1788390418.640291:0:10310:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640344:0:13700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788390418.640350:0:13700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+4:13698:x1875263098019584:12345-0@lo:104: Request processed in 2607us (5280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390418.640365:0:13700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1788390418.640387:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390418.640393:0:13157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390418.640399:0:10310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788390418.640401:0:13157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390418.640406:0:13157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390418.640407:0:10310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:13bece9d-37f8-46e7-9f27-a320529bc20d+3:13698:x1875263098019712:12345-0@lo:104: Request processed in 129us (5236us total) trans 0 rc 0/0 00010000:00010000:2.0:1788390418.640421:0:13157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390418.640432:0:13157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390418.640437:0:13157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788390418.640448:0:10310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788390418.640467:0:13157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640474:0:13157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390418.640504:0:13157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640511:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5200/0xe156d0713be9771f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be97726 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640525:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390418.640528:0:13157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.640536:0:13698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019584:0@lo:104: 00010000:00010000:2.0:1788390418.640548:0:13157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80800 already unused, calling callback (ffffffffc13bec20) 00000100:00100000:0.0:1788390418.640549:0:13698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019712:0@lo:104: 10000000:00010000:2.0:1788390418.640555:0:13157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640564:0:13157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390418.640570:0:13157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390418.640575:0:13157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788390418.640588:0:13157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640595:0:13157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390418.640622:0:13157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640629:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97703 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9770a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640639:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390418.640642:0:13157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640648:0:13157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390418.640651:0:13157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640667:0:13157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390418.640674:0:13157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390418.640679:0:13157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788390418.640693:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098020352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390418.640694:0:13157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640705:0:13157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390418.640712:0:13157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.640719:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e86a80000/0xe156d0713be976f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be976fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.640733:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390418.640735:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390418.640738:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390418.640741:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390418.640759:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390418.640770:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098020224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390418.640771:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390418.640782:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098020480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390418.640805:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390418.640830:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390418.640861:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098020352 00000100:00100000:0.0:1788390418.640867:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098020352 00010000:00010000:0.0:1788390418.640891:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97703 expref: 23 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.640917:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098020224 00000100:00100000:0.0:1788390418.640920:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098020224 00010000:00010000:0.0:1788390418.640932:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9771f expref: 24 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.640942:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098020480 00000100:00100000:0.0:1788390418.640945:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098020480 00010000:00010000:0.0:1788390418.640954:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be976f5 expref: 25 pid: 6487 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.640965:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788390418.640971:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+25:3624:x1875263098020352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390418.640980:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390418.640985:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be97703 expref: 25 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.640994:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be97703 expref: 25 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.641006:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf734400/0xe156d0713be9770a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be97703 expref: 25 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.641016:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390418.641044:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263098020352:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390418.641049:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788390418.641064:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390418.641069:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3622:x1875263098020224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390418.641083:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390418.641087:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be9771f expref: 23 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.641097:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be9771f expref: 23 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.641107:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a80200/0xe156d0713be97726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be9771f expref: 23 pid: 6484 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.641115:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390418.641142:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+22:3622:x1875263098020224:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390418.641148:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390418.641162:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390418.641168:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3624:x1875263098020480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390418.641175:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390418.641180:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be976f5 expref: 21 pid: 6487 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.641189:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be976f5 expref: 21 pid: 6487 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.641199:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be976fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be976f5 expref: 21 pid: 6487 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.641207:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390418.641227:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+20:3624:x1875263098020480:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390418.641243:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390418.641273:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098020480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390418.641281:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098020352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390418.641423:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098020224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390418.641647:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390418.641653:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390418.649743:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390418.649827:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390418.649917:0:13698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019840:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390418.649931:0:13698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88164700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13698:1875263098019968:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390418.649970:0:13698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390418.650538:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088514944 00000100:00100000:1.0:1788390418.650547:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088514944 00010000:00010000:1.0:1788390418.650585:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cff expref: 13 pid: 6486 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.650716:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088514816 00000100:00100000:0.0:1788390418.650721:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088514816 00010000:00010000:0.0:1788390418.650738:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d06 expref: 14 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.650836:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00100000:0.0:1788390418.650847:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88165500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+14:2405:x1875263088514944:12345-192.168.202.11@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788390418.651100:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:2.0:1788390418.651110:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+14:2404:x1875263088514816:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390418.651120:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390418.651138:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d06 expref: 14 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.651150:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d06 expref: 14 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.651167:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf734e00/0xe156d0713be976ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d06 expref: 14 pid: 6484 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.651184:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390418.651245:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2404:x1875263088514816:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 137us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390418.651252:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 51 00010000:00010000:0.0:1788390418.651513:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390418.651519:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cff expref: 12 pid: 6486 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651529:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cff expref: 12 pid: 6486 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651539:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b4800/0xe156d0713be976e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cff expref: 12 pid: 6486 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651562:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651570:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651586:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651592:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651599:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651605:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651612:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63c200 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390418.651616:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651694:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651718:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390418.651728:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390418.651830:0:13698:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.651838:0:13698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390418.651843:0:13698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf63c200/0xe156d0713be9785a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390418.652702:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88165500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+11:2405:x1875263088514944:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 1854us (2966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390418.652717:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 50 00000020:00000080:0.0:1788390419.150184:0:13748:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceb51a040 20000000:00000080:0.0:1788390419.150200:0:13748:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984fbb342000 uarg=0000000000000000 20000000:01000000:0.0:1788390419.150252:0:13748:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788390419.150258:0:13748:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788390419.150263:0:13748:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788390419.150823:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1788390419.151496:0:13748:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1788390419.151577:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1788390419.151607:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1788390419.151625:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1788390419.151637:0:13748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788390419.151660:0:13748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151678:0:13748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151689:0:13748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151696:0:13748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151704:0:13748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151711:0:13748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151717:0:13748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390419.151730:0:13748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151738:0:13748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151751:0:13748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151758:0:13748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.151765:0:13748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a81600/0xe156d0713be97861 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.603650:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788390419.729449:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390419.729457:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fc18b3800 from 7 10000000:01000000:2.0:1788390419.729463:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390419.729513:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390419.729525:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390419.729555:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390419.729579:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098020608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390419.729646:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390419.729725:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390419.729856:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098020608 00000100:00100000:0.0:1788390419.729875:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098020608 00000100:00100000:0.0:1788390419.730058:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788390419.730070:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+20:6489:x1875263098020608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390419.730083:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390419.730096:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a81600/0xe156d0713be9786f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97868 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.730118:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a81600/0xe156d0713be9786f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97868 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.730128:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a81600/0xe156d0713be9786f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97868 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.730137:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81600, rc 0) 00000100:00100000:0.0:1788390419.730192:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098020608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.730198:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788390419.730367:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098020608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390419.730396:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390419.730406:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390419.730466:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098020736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390419.730494:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390419.730525:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390419.731043:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098020736 00000100:00100000:0.0:1788390419.731050:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098020736 00000100:00100000:0.0:1788390419.731092:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788390419.731099:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098020736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.731226:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098020736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.731233:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788390419.731346:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098020736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390419.731384:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098020864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390419.731435:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390419.731462:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e868333c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390419.731523:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098020864 00000100:00100000:2.0:1788390419.731528:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098020864 00000100:00100000:2.0:1788390419.731561:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788390419.731567:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098020864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390419.731651:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098020864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390419.731658:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788390419.731734:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098020864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390419.732630:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390419.732662:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390419.732692:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390419.732711:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390419.732732:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390419.732757:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390419.732779:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088515328 00000100:00100000:1.0:1788390419.732785:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088515328 00000100:00100000:1.0:1788390419.732824:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088515584 00000100:00100000:1.0:1788390419.732827:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088515584 00000100:00100000:1.0:1788390419.732842:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088515200 00000100:00100000:1.0:1788390419.732845:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088515200 00000100:00100000:0.0:1788390419.732855:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088515072 00000100:00100000:1.0:1788390419.732859:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088515712 00000100:00100000:0.0:1788390419.732862:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088515072 00000100:00100000:1.0:1788390419.732864:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088515712 00000100:00100000:1.0:1788390419.732876:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 147 00000100:00100000:1.0:1788390419.732887:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088515328:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390419.732912:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 324 00000100:00100000:0.0:1788390419.732922:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+11:2407:x1875263088515072:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390419.732941:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088515328:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 56us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.732948:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 147 00000100:00100000:1.0:1788390419.732961:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 148 00000100:00100000:1.0:1788390419.732967:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088515584:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390419.732987:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088515584:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 20us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.732992:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 148 00000100:00100000:1.0:1788390419.733011:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 149 00000100:00100000:1.0:1788390419.733016:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:2407:x1875263088515200:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390419.733040:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:2407:x1875263088515200:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 23us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.733047:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 149 00000100:00100000:1.0:1788390419.733057:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 150 00000100:00100000:1.0:1788390419.733063:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088515712:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390419.733074:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+11:2407:x1875263088515072:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 153us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.733083:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 324 00000100:00100000:1.0:1788390419.733089:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088515712:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.733097:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 150 00000100:00080000:0.0:1788390419.733148:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390419.733154:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390419.733271:0:13761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88167100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13761:1875263098020992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390419.733344:0:13761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390419.733368:0:13761:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390419.733605:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088515456 00000100:00100000:2.0:1788390419.733610:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088515456 00000100:00100000:2.0:1788390419.733658:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:2.0:1788390419.733682:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088515456:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390419.733716:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088515456:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 46us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390419.733723:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00080000:1.0:1788390419.733895:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390419.734477:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098020992 00000100:00100000:0.0:1788390419.734482:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098020992 00000100:00100000:0.0:1788390419.734522:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788390419.734529:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:13761:x1875263098020992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390419.734643:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+21:13761:x1875263098020992:12345-0@lo:502:llog_process_th.0 Request processed in 115us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.734650:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788390419.734853:0:13761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88167100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13761:1875263098020992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390419.734998:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390419.735008:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390419.735011:0:13761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390419.735016:0:13761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fc18b3800 00000020:00000080:1.0:1788390419.735018:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390419.735072:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390419.735076:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390419.735077:0:13761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390419.735079:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390419.735082:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390419.735083:0:13761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788390419.735086:0:13761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fc18b3800 00000020:00000080:1.0:1788390419.735089:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788390419.735124:0:13761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13761:1875263098021120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390419.735161:0:13761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390419.735202:0:13761:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e868333c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390419.735262:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098021120 00000100:00100000:2.0:1788390419.735267:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098021120 00000100:00100000:2.0:1788390419.735307:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788390419.735314:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:13761:x1875263098021120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390419.735408:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+21:13761:x1875263098021120:12345-0@lo:502:llog_process_th.0 Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390419.735414:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788390419.735938:0:13761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13761:1875263098021120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390419.735958:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390419.735963:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390419.735964:0:13761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788390419.735968:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788390419.736124:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788390419.736147:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390419.736157:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.736168:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390419.736177:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390419.736180:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fb7b73800 from 7 10000000:01000000:0.0:1788390419.736183:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390419.736208:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.736216:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.736225:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390419.736239:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098021248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.736271:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390419.736310:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a7ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390419.737066:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098021248 00000100:00100000:1.0:1788390419.737072:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098021248 00000100:00100000:1.0:1788390419.737114:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788390419.737124:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+21:6489:x1875263098021248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390419.737134:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390419.737147:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5c00/0xe156d0713be9787d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97876 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390419.737169:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5c00/0xe156d0713be9787d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97876 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390419.737179:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5c00/0xe156d0713be9787d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97876 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390419.737188:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5c00, rc 0) 00000100:00100000:1.0:1788390419.737229:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098021248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.737236:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788390419.738013:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098021248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390419.738029:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.738039:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390419.738119:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098021376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.738153:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390419.738187:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a7ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390419.738359:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098021376 00000100:00100000:1.0:1788390419.738364:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098021376 00000100:00100000:1.0:1788390419.738392:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788390419.738400:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098021376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390419.738512:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098021376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390419.738525:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788390419.738596:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098021376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390419.738625:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098021504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390419.738661:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390419.738687:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390419.738734:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098021504 00000100:00100000:0.0:1788390419.738738:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098021504 00000100:00100000:0.0:1788390419.738837:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788390419.738844:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098021504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.741502:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098021504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2650us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.741516:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788390419.747027:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098021504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390419.748102:0:13764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13764:1875263098021632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390419.748166:0:13764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390419.748243:0:13764:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e868330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390419.748598:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098021632 00000100:00100000:0.0:1788390419.748603:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098021632 00000100:00100000:0.0:1788390419.748642:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788390419.748651:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:13764:x1875263098021632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390419.748757:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+22:13764:x1875263098021632:12345-0@lo:502:llog_process_th.0 Request processed in 106us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.748764:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788390419.748777:0:13764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13764:1875263098021632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390419.748796:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390419.748805:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390419.748807:0:13764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390419.748814:0:13764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fb7b73800 00000020:00000080:1.0:1788390419.748816:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390419.748944:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390419.748948:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390419.748950:0:13764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390419.748953:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390419.748955:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390419.748957:0:13764:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788390419.748960:0:13764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fb7b73800 00000020:00000080:1.0:1788390419.748962:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788390419.749794:0:13764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13764:1875263098021760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390419.750018:0:13764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390419.750093:0:13764:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e868330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390419.750131:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098021760 00000100:00100000:0.0:1788390419.750138:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098021760 00000100:00100000:0.0:1788390419.750220:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788390419.750230:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:13764:x1875263098021760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390419.750353:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:13764:x1875263098021760:12345-0@lo:502:llog_process_th.0 Request processed in 125us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.750369:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788390419.750451:0:13764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13764:1875263098021760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390419.750471:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390419.750477:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390419.750479:0:13764:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788390419.750488:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788390419.751137:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788390419.751160:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390419.751170:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390419.751235:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390419.751249:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390419.751253:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fb76a1000 from 7 10000000:01000000:2.0:1788390419.751256:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390419.751285:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390419.751311:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390419.752986:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390419.753017:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098021888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390419.753083:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390419.753125:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390419.753241:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098021888 00000100:00100000:0.0:1788390419.753247:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098021888 00000100:00100000:0.0:1788390419.753289:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788390419.753308:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+22:6489:x1875263098021888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390419.753341:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390419.753356:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a80000/0xe156d0713be9788b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97884 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.753380:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a80000/0xe156d0713be9788b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97884 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.753391:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a80000/0xe156d0713be9788b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97884 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.753401:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80000, rc 0) 00000100:00100000:0.0:1788390419.753438:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098021888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.753445:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788390419.753491:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098021888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390419.753504:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.753513:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390419.753572:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.753603:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390419.753619:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a7e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390419.753638:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098022016 00000100:00100000:0.0:1788390419.753642:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098022016 00000100:00100000:0.0:1788390419.753662:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788390419.753669:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098022016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.753767:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098022016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.753774:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788390419.753802:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.754690:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.754742:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390419.754766:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a7e6c0 going to sleep for 11 seconds 00000040:00080000:2.0:1788390419.754811:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788390419.754835:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098022144 00000100:00100000:1.0:1788390419.754842:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098022144 00000100:00100000:1.0:1788390419.754880:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788390419.754899:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098022144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390419.755012:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098022144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.755044:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390419.755125:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788390419.755505:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13766:1875263098022272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390419.755545:0:13766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390419.755616:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e879543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390419.755649:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098022272 00000100:00100000:3.0:1788390419.755654:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098022272 00000100:00100000:3.0:1788390419.755691:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788390419.755701:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+23:13766:x1875263098022272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390419.755818:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+23:13766:x1875263098022272:12345-0@lo:502:llog_process_th.0 Request processed in 119us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390419.755825:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788390419.756052:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13766:1875263098022272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788390419.756078:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390419.756089:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390419.756091:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788390419.756098:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fb76a1000 00000020:00000080:2.0:1788390419.756101:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788390419.756185:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390419.756259:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390419.756262:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788390419.756266:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390419.756269:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390419.756271:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788390419.756275:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fb76a1000 00000020:00000080:2.0:1788390419.756277:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788390419.756386:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13766:1875263098022400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390419.756426:0:13766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390419.756484:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e879543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390419.759056:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098022400 00000100:00100000:3.0:1788390419.759069:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098022400 00000100:00100000:3.0:1788390419.759178:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788390419.759260:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:13766:x1875263098022400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390419.759449:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:13766:x1875263098022400:12345-0@lo:502:llog_process_th.0 Request processed in 260us (3020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390419.759458:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788390419.759564:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13766:1875263098022400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788390419.759595:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390419.759603:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390419.759605:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788390419.759610:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788390419.759786:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788390419.759815:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390419.759825:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.760024:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390419.760036:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390419.760038:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984f988e6800 from 7 10000000:01000000:0.0:1788390419.760041:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390419.760075:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.760084:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.760106:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390419.760126:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.760162:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390419.760304:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390419.760386:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098022528 00000100:00100000:3.0:1788390419.760391:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098022528 00000100:00100000:3.0:1788390419.760415:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788390419.760422:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:6489:x1875263098022528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390419.760431:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390419.760448:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf63d000/0xe156d0713be97899 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be97892 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390419.760470:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf63d000/0xe156d0713be97899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be97892 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390419.760480:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf63d000/0xe156d0713be97899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be97892 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390419.760488:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63d000, rc 0) 00000100:00100000:3.0:1788390419.760516:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098022528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390419.760522:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788390419.760603:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390419.760615:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.760624:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390419.760671:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.760694:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390419.760719:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390419.760763:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098022656 00000100:00100000:3.0:1788390419.760767:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098022656 00000100:00100000:3.0:1788390419.760794:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788390419.760801:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098022656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390419.761123:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098022656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390419.761130:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788390419.761260:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.761286:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.761359:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390419.761374:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390419.761442:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098022784 00000100:00100000:3.0:1788390419.761446:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098022784 00000100:00100000:3.0:1788390419.761468:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788390419.761475:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098022784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390419.761539:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:6489:x1875263098022784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390419.761546:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788390419.761633:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bece9d-37f8-46e7-9f27-a320529bc20d:6489:1875263098022784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390419.762316:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13768:1875263098022912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390419.762574:0:13768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390419.762634:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88d37e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390419.762676:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098022912 00000100:00100000:3.0:1788390419.762684:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098022912 00000100:00100000:3.0:1788390419.762754:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788390419.762762:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:13768:x1875263098022912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390419.762855:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:13768:x1875263098022912:12345-0@lo:502:llog_process_th.0 Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390419.762861:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788390419.762988:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13768:1875263098022912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788390419.763012:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390419.763021:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390419.763023:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788390419.763030:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984f988e6800 00000020:00000080:2.0:1788390419.763032:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788390419.763095:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390419.763099:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390419.763100:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788390419.763103:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390419.763105:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390419.763106:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788390419.763110:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984f988e6800 00000020:00000080:2.0:1788390419.763112:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788390419.763146:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13768:1875263098023040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390419.763179:0:13768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390419.763524:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098023040 00000100:00100000:0.0:1788390419.763529:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098023040 00000100:00100000:0.0:1788390419.764147:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788390419.764155:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:13768:x1875263098023040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390419.764286:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:13768:x1875263098023040:12345-0@lo:502:llog_process_th.0 Request processed in 132us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390419.764301:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788390419.764469:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e879543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390419.764483:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bece9d-37f8-46e7-9f27-a320529bc20d:13768:1875263098023040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788390419.764503:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390419.764506:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390419.764508:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788390419.764514:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788390419.764679:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788390419.764698:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390419.764707:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390419.764719:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390419.767655:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788390420.049640:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390420.049668:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098023168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788390420.049762:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390420.049966:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098023168 00000100:00100000:1.0:1788390420.049977:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098023168 00000100:00100000:1.0:1788390420.050030:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788390420.050043:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f83f3c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098023168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788390420.050081:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788390420.050142:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f83f3c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098023168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390420.050150:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788390420.050586:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098023168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390420.117595:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390420.117721:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088515840 00000100:00100000:0.0:1788390420.117731:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088515840 00000100:00100000:0.0:1788390420.117832:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 342 00000100:00100000:0.0:1788390420.117842:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+11:6169:x1875263088515840:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390420.117861:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390420.117879:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a80c00/0xe156d0713be978a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d53 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390420.117908:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a80c00/0xe156d0713be978a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d53 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390420.117937:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a80c00/0xe156d0713be978a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d53 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390420.117946:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80c00, rc 0) 00000100:00100000:0.0:1788390420.118006:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088515840:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 Request processed in 165us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390420.118014:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 342 00000100:00100000:2.0:1788390420.121197:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390420.121309:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088515968 00000100:00100000:0.0:1788390420.121343:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088515968 00000100:00100000:0.0:1788390420.121469:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 343 00000100:00100000:0.0:1788390420.121480:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088515968:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390420.121767:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088515968:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 Request processed in 287us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390420.121775:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 343 00000100:00100000:1.0:1788390420.125732:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390420.125857:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088516096 00000100:00100000:0.0:1788390420.125867:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088516096 00000100:00100000:0.0:1788390420.125924:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 344 00000100:00100000:0.0:1788390420.125945:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088516096:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390420.128086:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088516096:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 Request processed in 2144us (2357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390420.128099:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 344 00000100:00100000:2.0:1788390420.142281:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390420.142792:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088516224 00000100:00100000:0.0:1788390420.142804:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088516224 00000100:00100000:0.0:1788390420.142917:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 345 00000100:00100000:0.0:1788390420.142928:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+12:10795:x1875263088516224:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390420.143102:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+12:10795:x1875263088516224:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 175us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390420.143110:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 345 00000100:00100000:2.0:1788390420.146425:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390420.146512:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088516352 00000100:00100000:0.0:1788390420.146522:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088516352 00000100:00100000:0.0:1788390420.146580:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 346 00000100:00100000:0.0:1788390420.146591:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:10795:x1875263088516352:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390420.146759:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:10795:x1875263088516352:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 169us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390420.146767:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 346 00000100:00100000:1.0:1788390420.150620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390420.150814:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088516480 00000100:00100000:0.0:1788390420.150825:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088516480 00000100:00100000:0.0:1788390420.150882:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 347 00000100:00100000:0.0:1788390420.150894:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+12:6169:x1875263088516480:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390420.150911:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390420.150930:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a81a00/0xe156d0713be978a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d5a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390420.150960:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a81a00/0xe156d0713be978a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d5a expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390420.150972:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a81a00/0xe156d0713be978a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d5a expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390420.150983:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81a00, rc 0) 00000100:00100000:0.0:1788390420.151045:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088516480:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 Request processed in 153us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390420.151065:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 347 00000100:00100000:2.0:1788390420.157004:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390420.157086:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088516608 00000100:00100000:0.0:1788390420.157096:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088516608 00000100:00100000:0.0:1788390420.157147:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 348 00000100:00100000:0.0:1788390420.157155:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088516608:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390420.157310:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088516608:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 Request processed in 154us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390420.157318:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 348 00000100:00100000:2.0:1788390420.164074:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390420.164437:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088516736 00000100:00100000:3.0:1788390420.164448:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088516736 00000100:00100000:3.0:1788390420.164649:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 349 00000100:00100000:3.0:1788390420.164660:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088516736:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390420.165022:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:6169:x1875263088516736:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 Request processed in 363us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390420.165031:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 349 00000100:00100000:1.0:1788390420.173871:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390420.174086:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088516864 00000100:00100000:2.0:1788390420.174098:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088516864 00000100:00100000:2.0:1788390420.174167:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 350 00000100:00100000:2.0:1788390420.174179:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:10798:x1875263088516864:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390420.174436:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:10798:x1875263088516864:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 257us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390420.174445:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 350 00000100:00100000:2.0:1788390420.177131:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390420.177266:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088516992 00000100:00100000:3.0:1788390420.177276:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088516992 00000100:00100000:3.0:1788390420.177439:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 351 00000100:00100000:3.0:1788390420.177452:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:10798:x1875263088516992:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390420.177627:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:10798:x1875263088516992:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 176us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390420.177636:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 351 00000001:00100000:0.0:1788390420.568706:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000020:00000080:0.0:1788390420.568720:0:9485:0:(genops.c:885:class_export_put()) final put ffff984e877d4800/ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000020:00000080:3.0:1788390420.568884:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984e877d4800/ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 for lustre-OST0001 00000020:00000080:3.0:1788390420.569014:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e877d6000 for lustre-OST0001 00010000:00010000:2.0:1788390420.625496:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390420.818742:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788390420.819498:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00080000:2.0:1788390421.589733:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788390421.589845:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788390421.589856:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788390421.589920:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.589935:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590372:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590400:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390421.590405:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590414:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590717:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff984e86840f00) 00010000:00010000:1.0:1788390421.590721:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390421.590727:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590734:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be977b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590759:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590765:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590771:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590777:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63cc00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390421.590781:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590787:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590808:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:1.0:1788390421.590810:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390421.590813:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590819:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be977c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590844:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590850:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590856:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590862:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390421.590865:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590871:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590878:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff984e86840f00) 00010000:00010000:1.0:1788390421.590880:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390421.590883:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590888:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97830 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590915:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590921:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590926:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.590931:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390421.590934:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.591101:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.591111:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984e86840800) 00010000:00010000:1.0:1788390421.591113:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390421.591116:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390421.591122:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9784c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390421.593627:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390421.593701:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098023296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788390421.593777:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390421.593922:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098023296 00000100:00100000:2.0:1788390421.593931:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098023296 00000100:00100000:2.0:1788390421.594044:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390421.594056:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098023296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788390421.594085:0:8798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788390421.594121:0:8798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a98ac0f, atime: 0x6a98ac0f, ctime: 0x6a98ac0f, blocks: 0x0 00010000:00010000:2.0:1788390421.594128:0:8798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.594159:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=242s v=(0 0) 00010000:00010000:2.0:1788390421.594164:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390421.594182:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.594200:0:8798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.594212:0:8798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.594220:0:8798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390421.594239:0:8798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390421.594265:0:13156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390421.594366:0:13156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390421.594378:0:13156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390421.594383:0:13156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390421.594392:0:13156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390421.594413:0:13156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390421.594421:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab3a58b/0xe156d0713be978ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390421.594451:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390421.594454:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390421.594458:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263098023296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 402us (678us total) trans 4294967301 rc 0/0 00010000:00010000:0.0:1788390421.594458:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390421.594468:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1788390421.594506:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e868c4e00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788390421.594513:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098023296:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788390421.594852:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788390421.649607:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390422.097516:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390422.097516:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098023424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390422.097535:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098023680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390422.097595:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390422.097623:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390422.097657:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390422.097660:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098023424 00000100:00100000:2.0:1788390422.097664:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098023552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390422.097670:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098023424 00000100:00100000:2.0:1788390422.097683:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390422.097721:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788390422.097731:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098023424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788390422.097766:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788390422.097930:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098023680 00000100:00100000:1.0:1788390422.097935:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098023680 00000100:00100000:1.0:1788390422.097969:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098023552 00000100:00100000:1.0:1788390422.097972:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098023552 00000100:00100000:1.0:1788390422.097996:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390422.098003:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098023680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390422.098023:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390422.098061:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098023680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390422.098069:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390422.098085:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788390422.098092:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098023552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788390422.098100:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390422.098142:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098023424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 413us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390422.098149:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788390422.098188:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098023680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390422.098230:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390422.100735:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098023424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390422.100828:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098023552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2735us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390422.100839:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788390422.101099:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098023552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788390422.611149:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390422.611177:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098023808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390422.611251:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390422.611537:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098023936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390422.611563:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390422.611651:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098023808 00000100:00100000:1.0:1788390422.611658:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098023808 00000100:00100000:1.0:1788390422.611711:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098023936 00000100:00100000:1.0:1788390422.611714:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098023936 00000100:00100000:1.0:1788390422.611731:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788390422.611739:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098023808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788390422.611765:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390422.611811:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098023808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390422.611818:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788390422.611836:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788390422.611844:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098023936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390422.611853:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390422.611896:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098023936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390422.611903:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788390422.611937:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e868c5180 x1875263098023808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390422.611956:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098023808:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788390422.612177:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788390422.612236:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e868c4700 x1875263098023936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390422.612250:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098023936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390422.614886:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098024064:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.614960:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390422.615003:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098024576:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615030:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390422.615051:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098025088:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615073:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390422.615090:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098024192:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615102:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788390422.615110:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098024448:0@lo:400:kworker.0 00000100:00100000:0.0:1788390422.615131:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390422.615152:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098025088 00000100:00100000:3.0:1788390422.615159:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098025088 00000100:00100000:0.0:1788390422.615162:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098024704:0@lo:400:kworker.0 00000100:00100000:0.0:1788390422.615185:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390422.615197:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098025216:0@lo:400:kworker.0 00000100:00100000:0.0:1788390422.615210:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390422.615220:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390422.615225:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788390422.615230:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098024320:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615236:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1875263098025088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390422.615247:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390422.615258:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098024832:0@lo:400:kworker.0 00000100:00100000:0.0:1788390422.615305:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390422.615306:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1875263098025088:12345-0@lo:400:kworker.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390422.615360:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390422.615385:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098025344:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615393:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390422.615414:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390422.615419:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098024960:0@lo:400:kworker.0 00000100:00100000:0.0:1788390422.615444:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098024576 00000100:00100000:3.0:1788390422.615449:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390422.615450:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098024576 00000100:00100000:0.0:1788390422.615484:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098024320 00000100:00100000:3.0:1788390422.615487:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098025088:0@lo:400:kworker.0 00000100:00100000:0.0:1788390422.615489:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098024320 00000100:00100000:0.0:1788390422.615509:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788390422.615520:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098024576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615531:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098024192 00000100:00100000:3.0:1788390422.615536:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098024192 00000100:00100000:3.0:1788390422.615560:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098024704 00000100:00100000:3.0:1788390422.615562:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098024704 00000100:00100000:0.0:1788390422.615574:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098024576:12345-0@lo:400:kworker.0 Request processed in 57us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390422.615583:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788390422.615584:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098025216 00000100:00100000:3.0:1788390422.615589:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098025216 00000100:00100000:0.0:1788390422.615606:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788390422.615607:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098024832 00000100:00100000:3.0:1788390422.615611:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098024832 00000100:00100000:0.0:1788390422.615618:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098024320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615624:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098024448 00000100:00100000:3.0:1788390422.615628:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098024448 00000100:00100000:3.0:1788390422.615646:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098025344 00000100:00100000:3.0:1788390422.615648:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098025344 00000100:00100000:0.0:1788390422.615659:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098024320:12345-0@lo:400:kworker.0 Request processed in 44us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390422.615666:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788390422.615670:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788390422.615676:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098024192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615710:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098024192:12345-0@lo:400:kworker.0 Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390422.615716:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788390422.615731:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788390422.615737:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098024704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390422.615751:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098024320:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615765:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098024704:12345-0@lo:400:kworker.0 Request processed in 27us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390422.615770:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098024192:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615776:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788390422.615785:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098024704:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615807:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788390422.615817:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098025216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615853:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098025216:12345-0@lo:400:kworker.0 Request processed in 39us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390422.615860:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788390422.615877:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098025216:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615878:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788390422.615890:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098024832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615933:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098024832:12345-0@lo:400:kworker.0 Request processed in 45us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390422.615938:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788390422.615949:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788390422.615954:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098024448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.615976:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098024448:12345-0@lo:400:kworker.0 Request processed in 23us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390422.615981:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788390422.615990:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788390422.615996:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098025344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.616020:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098025344:12345-0@lo:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390422.616025:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788390422.616055:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098024448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390422.616067:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098024576:0@lo:400:kworker.0 00010000:00080000:0.0:1788390422.616167:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e877c9880 x1875263098024832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390422.616179:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098024832:0@lo:400:kworker.0 00010000:00080000:0.0:1788390422.616189:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b44a80 x1875263098025344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390422.616197:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098025344:0@lo:400:kworker.0 00000100:00080000:2.0:1788390422.616248:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788390422.616253:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390422.616263:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098024960 00000100:00100000:2.0:1788390422.616276:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098024960 00000100:00100000:2.0:1788390422.616308:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788390422.616315:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098024960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390422.616383:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098024960:12345-0@lo:400:kworker.0 Request processed in 68us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390422.616389:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788390422.616408:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098024064 00000100:00100000:2.0:1788390422.616411:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098024064 00000100:00100000:2.0:1788390422.616446:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788390422.616452:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098024064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390422.616480:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098024064:12345-0@lo:400:kworker.0 Request processed in 29us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390422.616485:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788390422.616570:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098024960:0@lo:400:kworker.0 00000100:00100000:0.0:1788390422.616582:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098024064:0@lo:400:kworker.0 00010000:00010000:0.0:1788390422.674416:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390423.698548:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390424.721913:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390424.856403:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390424.856491:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390424.856524:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390424.856592:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088517120 00000100:00100000:3.0:1788390424.856601:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088517120 00000100:00100000:0.0:1788390424.856652:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390424.856706:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 353 00000100:00100000:3.0:1788390424.856730:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088517120:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390424.856806:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088517120:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 78us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390424.856813:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 353 00000100:00100000:0.0:1788390424.861584:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390424.861621:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390424.861692:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088517376 00000100:00100000:2.0:1788390424.861707:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088517376 00000100:00100000:2.0:1788390424.862336:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088517632 00000100:00100000:2.0:1788390424.862343:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088517632 00000100:00100000:2.0:1788390424.862366:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088517248 00000100:00100000:2.0:1788390424.862383:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088517248 00000100:00100000:2.0:1788390424.862406:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 157 00000100:00100000:2.0:1788390424.862414:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088517376:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390424.862480:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088517376:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 67us (5989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.862485:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 157 00000100:00100000:2.0:1788390424.862498:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 158 00000100:00100000:2.0:1788390424.862502:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088517632:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390424.862517:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088517632:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 15us (5993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.862520:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 158 00000100:00100000:2.0:1788390424.862526:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 159 00000100:00100000:2.0:1788390424.862529:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088517248:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390424.862552:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088517248:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 22us (5901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.862557:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 159 00000100:00080000:2.0:1788390424.862571:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390424.862574:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788390424.862686:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088517504 00000100:00100000:2.0:1788390424.862689:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088517504 00000100:00100000:2.0:1788390424.862719:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00100000:2.0:1788390424.862737:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088517504:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390424.862772:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088517504:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 47us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.862776:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00080000:2.0:1788390424.862792:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390424.864219:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088517760 00000100:00100000:2.0:1788390424.864227:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088517760 00000100:00080000:0.0:1788390424.864395:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788390424.864594:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 160 00000100:00100000:2.0:1788390424.864604:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088517760:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390424.864662:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088517760:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 60us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390424.864669:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 160 00000100:00100000:2.0:1788390425.172372:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098025472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390425.172470:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390425.174677:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098025472 00000100:00100000:1.0:1788390425.174692:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098025472 00000100:00100000:1.0:1788390425.174756:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788390425.174768:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098025472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788390425.174808:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788390425.174900:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098025472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390425.174908:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788390425.174942:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098025472:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788390425.745622:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390426.769677:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390427.217885:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390427.217910:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098025600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788390427.217984:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390427.218084:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098025600 00000100:00100000:2.0:1788390427.218094:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098025600 00000100:00080000:1.0:1788390427.218289:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390427.218551:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788390427.218564:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098025600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788390427.218603:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390427.218664:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098025600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.218686:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788390427.218745:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098025600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390427.219209:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390427.219244:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098025728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390427.219313:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390427.219396:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098025728 00000100:00100000:1.0:1788390427.219411:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098025728 00000100:00100000:1.0:1788390427.219472:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788390427.219482:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098025728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390427.219504:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390427.219568:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098025728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390427.219577:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788390427.219609:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390427.219624:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098025856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788390427.219672:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390427.219712:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098025856 00000100:00100000:0.0:1788390427.219718:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098025856 00000100:00100000:0.0:1788390427.219752:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788390427.219761:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098025856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788390427.219789:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788390427.219827:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098025856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390427.219834:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788390427.219876:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098025856:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788390427.219911:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390427.219950:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098025728:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788390427.222725:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788390427.729542:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098025984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390427.729640:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390427.729670:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098026112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390427.729724:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098026624:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.729767:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390427.729774:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390427.729803:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098027136:0@lo:400:kworker.0 00000100:00100000:1.0:1788390427.729840:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390427.729844:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098026496:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.729893:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390427.729910:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098025984 00000100:00100000:1.0:1788390427.729917:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098025984 00000100:00100000:3.0:1788390427.730075:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098026624 00000100:00100000:3.0:1788390427.730080:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098026624 00000100:00100000:2.0:1788390427.730170:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098027008:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.730205:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390427.730904:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098026240:0@lo:400:kworker.0 00000100:00100000:0.0:1788390427.730952:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390427.730985:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098026752:0@lo:400:kworker.0 00000100:00100000:0.0:1788390427.731029:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390427.731052:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098027264:0@lo:400:kworker.0 00000100:00100000:1.0:1788390427.731075:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098026112 00000100:00100000:0.0:1788390427.731081:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390427.731082:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098026112 00000100:00100000:1.0:1788390427.731109:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788390427.731110:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788390427.731120:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098026368:0@lo:400:kworker.0 00000100:00100000:1.0:1788390427.731122:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbfbd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098025984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788390427.731156:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390427.731172:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390427.731182:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098026112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390427.731196:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390427.731208:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbfbd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098025984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390427.731216:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788390427.731250:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098026112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390427.731257:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788390427.731763:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8803ad80 x1875263098026112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390427.731783:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098026112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390427.731803:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098027520:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.731829:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390427.731859:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098027008 00000100:00100000:2.0:1788390427.731863:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098027008 00000100:00100000:2.0:1788390427.731888:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098027520 00000100:00100000:2.0:1788390427.731891:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098027520 00000100:00100000:2.0:1788390427.731905:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788390427.731911:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098026624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.731943:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098026624:12345-0@lo:400:kworker.0 Request processed in 32us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.731949:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788390427.731961:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788390427.731966:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098027008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.731992:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098027008:12345-0@lo:400:kworker.0 Request processed in 26us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.731998:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788390427.732009:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788390427.732015:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098027520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.732051:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098027520:12345-0@lo:400:kworker.0 Request processed in 37us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.732057:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00080000:2.0:1788390427.732083:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb219880 x1875263098027520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390427.732091:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098027520:0@lo:400:kworker.0 00010000:00080000:2.0:1788390427.732100:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb21bb80 x1875263098027008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390427.732107:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098027008:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.732153:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098027136 00000100:00100000:2.0:1788390427.732156:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098027136 00000100:00100000:2.0:1788390427.732176:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098027264 00000100:00100000:2.0:1788390427.732178:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098027264 00000100:00100000:2.0:1788390427.732192:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788390427.732197:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098027136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.732238:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098027136:12345-0@lo:400:kworker.0 Request processed in 40us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.732252:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788390427.732270:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788390427.732276:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098027264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.732304:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098027264:12345-0@lo:400:kworker.0 Request processed in 28us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.732310:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788390427.732356:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788390427.732361:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390427.732378:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098026496 00000100:00100000:2.0:1788390427.732382:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098026496 00000100:00100000:2.0:1788390427.732407:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098026752 00000100:00100000:2.0:1788390427.732411:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098026752 00000100:00100000:2.0:1788390427.732423:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788390427.732431:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098026496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.732657:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098026496:12345-0@lo:400:kworker.0 Request processed in 226us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.732664:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788390427.732678:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788390427.732685:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098026752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.732713:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098026752:12345-0@lo:400:kworker.0 Request processed in 30us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.732719:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788390427.732747:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098027136:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.732760:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098026624:0@lo:400:kworker.0 00010000:00080000:2.0:1788390427.732773:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e86bd6680 x1875263098025984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390427.732788:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098025984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390427.732817:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098026240 00000100:00100000:2.0:1788390427.732821:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098026240 00000100:00100000:2.0:1788390427.732849:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788390427.732855:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098026240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.732886:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098026240:12345-0@lo:400:kworker.0 Request processed in 31us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.732903:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788390427.732943:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098026496:0@lo:400:kworker.0 00000100:00100000:0.0:1788390427.732962:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390427.732989:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098026368 00000100:00100000:2.0:1788390427.732994:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098026368 00000100:00100000:0.0:1788390427.733007:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098026880:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.733020:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788390427.733028:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098026368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390427.733038:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390427.733057:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098027392:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.733075:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098026368:12345-0@lo:400:kworker.0 Request processed in 46us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390427.733081:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390427.733089:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788390427.733099:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098026240:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.733104:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098026880 00000100:00100000:2.0:1788390427.733109:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098026880 00000100:00100000:0.0:1788390427.733114:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098026752:0@lo:400:kworker.0 00000100:00100000:0.0:1788390427.733127:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788390427.733133:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984e868c4e00, transno 4294967301 00000100:00100000:2.0:1788390427.733135:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098027392 00000100:00100000:2.0:1788390427.733140:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098027392 00000100:00100000:0.0:1788390427.733146:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098027264:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.733160:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788390427.733170:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098026880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390427.733176:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098026368:0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.733211:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098026880:12345-0@lo:400:kworker.0 Request processed in 42us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.733230:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788390427.733246:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788390427.733336:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098026880:0@lo:400:kworker.0 00000100:00080000:0.0:1788390427.733385:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390427.733731:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098027392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390427.733772:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098027392:12345-0@lo:400:kworker.0 Request processed in 518us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390427.733779:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788390427.735046:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098027392:0@lo:400:kworker.0 00010000:00010000:2.0:1788390427.793483:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390428.818241:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390429.845236:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390429.976632:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390429.976671:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390429.976768:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088517888 00000100:00100000:3.0:1788390429.976777:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088517888 00000100:00100000:3.0:1788390429.976824:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 355 00000100:00100000:3.0:1788390429.976832:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088517888:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390429.976902:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088517888:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 70us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390429.976910:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 355 00000100:00100000:2.0:1788390429.977177:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390429.977282:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390429.977307:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088518016 00000100:00100000:3.0:1788390429.977311:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088518016 00000100:00100000:2.0:1788390429.977413:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088518272 00000100:00100000:2.0:1788390429.977416:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088518272 00000100:00100000:3.0:1788390429.977450:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088518144 00000100:00100000:3.0:1788390429.977453:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088518144 00000100:00100000:0.0:1788390429.977667:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 167 00000100:00100000:0.0:1788390429.977678:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088518016:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390429.977723:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088518016:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 47us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390429.977730:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 167 00000100:00080000:1.0:1788390429.977939:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390429.977943:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390429.977945:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390429.978019:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:2.0:1788390429.978025:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088518272:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390429.978052:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088518272:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 27us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390429.978056:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:3.0:1788390429.978268:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 168 00000100:00100000:3.0:1788390429.978280:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088518144:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390429.978306:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088518144:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 34us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390429.978310:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 168 00000100:00100000:3.0:1788390429.978358:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390429.978562:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390429.978582:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088518400 00000100:00100000:3.0:1788390429.978587:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088518400 00000100:00100000:3.0:1788390429.978622:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088518528 00000100:00100000:3.0:1788390429.978625:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088518528 00000100:00100000:3.0:1788390429.978637:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 169 00000100:00100000:3.0:1788390429.978641:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088518400:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390429.978669:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088518400:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390429.978676:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 169 00000100:00100000:3.0:1788390429.978688:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 170 00000100:00100000:3.0:1788390429.978707:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088518528:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390429.978723:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088518528:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 19us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390429.978727:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 170 00000100:00080000:1.0:1788390429.979056:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390429.979060:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788390430.034060:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788390430.035262:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788390430.297796:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098027648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390430.298353:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390430.298621:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098027648 00000100:00100000:2.0:1788390430.298629:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098027648 00000100:00100000:2.0:1788390430.298672:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788390430.298682:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098027648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390430.298716:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788390430.298777:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098027648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390430.298784:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788390430.298871:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098027648:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788390430.868535:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390431.889550:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390432.337852:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098027776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788390432.337963:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390432.338047:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390432.338058:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098027904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788390432.338087:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390432.338244:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098027776 00000100:00100000:0.0:1788390432.338257:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098027776 00000100:00100000:0.0:1788390432.338361:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788390432.338383:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098028032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390432.338384:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098027776:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390432.338439:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788390432.338448:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788390432.338549:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098027776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390432.338556:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788390432.338596:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098027904 00000100:00100000:0.0:1788390432.338601:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098027904 00000100:00100000:0.0:1788390432.338657:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098028032 00000100:00100000:0.0:1788390432.338660:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098028032 00000100:00100000:0.0:1788390432.338672:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788390432.338676:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098027904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788390432.338697:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390432.338739:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098027904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390432.338765:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788390432.338786:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788390432.338791:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098028032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390432.338798:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390432.338817:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098028032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390432.338821:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788390432.338847:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390432.342848:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098027904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788390432.342871:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098027776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390432.350169:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098028032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390432.849622:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098028544:0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.849712:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098028160:0@lo:400:kworker.0 00000100:00100000:2.0:1788390432.849721:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390432.849762:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390432.849790:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098028160 00000100:00100000:2.0:1788390432.849797:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098028160 00000100:00100000:2.0:1788390432.849848:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788390432.849855:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098028160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390432.849894:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098028160:12345-0@lo:400:kworker.0 Request processed in 40us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390432.849900:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788390432.849934:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098028544 00000100:00100000:0.0:1788390432.849939:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098028544 00000100:00100000:2.0:1788390432.849943:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098029056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390432.849977:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788390432.849978:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390432.849989:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098028544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390432.850006:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098029056 00000100:00100000:2.0:1788390432.850009:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098029056 00000100:00100000:0.0:1788390432.850037:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098028544:12345-0@lo:400:kworker.0 Request processed in 50us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390432.850040:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788390432.850048:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098029056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390432.850051:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00002000:00000024:2.0:1788390432.850070:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788390432.850101:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390432.850188:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098028160:0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850199:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098028672:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850208:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098028416:0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850238:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390432.850246:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098028288:0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850267:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098029184:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850276:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390432.850299:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390432.850306:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098028800:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850349:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390432.850349:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098029696:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850366:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098029312:0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850382:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390432.850393:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098028288 00000100:00100000:3.0:1788390432.850396:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098028288 00000100:00100000:3.0:1788390432.850419:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098028800 00000100:00100000:3.0:1788390432.850422:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098028800 00000100:00100000:1.0:1788390432.850423:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390432.850431:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098029568:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850439:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788390432.850446:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098028288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850458:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390432.850486:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098028288:12345-0@lo:400:kworker.0 Request processed in 42us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390432.850492:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788390432.850495:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098029184 00000100:00100000:1.0:1788390432.850500:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098029184 00000100:00100000:3.0:1788390432.850503:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098029568 00000100:00100000:3.0:1788390432.850506:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098029568 00000100:00100000:3.0:1788390432.850524:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788390432.850528:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098028800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850538:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098029696 00000100:00100000:1.0:1788390432.850543:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098029696 00000100:00100000:3.0:1788390432.850546:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098028800:12345-0@lo:400:kworker.0 Request processed in 17us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390432.850551:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788390432.850562:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788390432.850567:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098029568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850575:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788390432.850585:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098029184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850590:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098029568:12345-0@lo:400:kworker.0 Request processed in 22us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390432.850595:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788390432.850607:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390432.850610:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788390432.850612:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390432.850631:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098029184:12345-0@lo:400:kworker.0 Request processed in 47us (331us total) trans 0 rc 0/0 00010000:00080000:3.0:1788390432.850638:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87b45c00 x1875263098029056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390432.850654:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788390432.850659:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098029056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390432.850678:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788390432.850679:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098028544:0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850690:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098029696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850702:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390432.850718:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098028928:0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850728:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098029696:12345-0@lo:400:kworker.0 Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390432.850740:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390432.850740:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788390432.850760:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098029440:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850777:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788390432.850784:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88069180 x1875263098029568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390432.850789:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098029952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390432.850803:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098029568:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850808:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390432.850824:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098029184:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850833:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098028928 00000100:00100000:3.0:1788390432.850837:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098028928 00010000:00080000:1.0:1788390432.850841:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88068e00 x1875263098029696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390432.850851:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098029696:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850856:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098029440 00000100:00100000:3.0:1788390432.850859:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098029440 00000100:00100000:3.0:1788390432.850876:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788390432.850881:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098028928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.850899:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390432.850908:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098028928:12345-0@lo:400:kworker.0 Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390432.850913:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788390432.850922:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788390432.850925:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098029824:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850930:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098029440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.850964:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098029440:12345-0@lo:400:kworker.0 Request processed in 36us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390432.850968:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390432.850986:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1788390432.851001:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390432.851001:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098028288:0@lo:400:kworker.0 00000100:00080000:3.0:1788390432.851005:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390432.851021:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098028800:0@lo:400:kworker.0 00010000:00080000:3.0:1788390432.851025:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88069500 x1875263098028928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390432.851033:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098028928:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.851042:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098029440:0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.851049:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098029312 00000100:00100000:1.0:1788390432.851054:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098029312 00000100:00100000:3.0:1788390432.851075:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098029952 00000100:00100000:1.0:1788390432.851080:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098029824 00000100:00100000:3.0:1788390432.851081:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098029952 00000100:00100000:1.0:1788390432.851085:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098029824 00000100:00100000:1.0:1788390432.851099:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390432.851115:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098029312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390432.851150:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098029312:12345-0@lo:400:kworker.0 Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390432.851156:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390432.851168:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390432.851187:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263098029824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390432.851196:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098029056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1148us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390432.851202:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788390432.851219:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098029824:12345-0@lo:400:kworker.0 Request processed in 43us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390432.851227:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390432.851258:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098029312:0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.851273:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788390432.851275:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8806b100 x1875263098029824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390432.851286:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098029952:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390432.851288:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098029824:0@lo:400:kworker.0 00002000:00000024:3.0:1788390432.851300:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390432.851345:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098029952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390432.851350:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788390432.851363:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88167800 x1875263098029952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390432.851376:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098029952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788390432.851442:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098028672 00000100:00100000:0.0:1788390432.851447:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098028672 00000100:00100000:0.0:1788390432.851478:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098028416 00000100:00100000:0.0:1788390432.851481:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098028416 00000100:00100000:0.0:1788390432.851494:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788390432.851501:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098028672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390432.851546:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098028672:12345-0@lo:400:kworker.0 Request processed in 45us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390432.851553:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788390432.851569:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788390432.851576:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098028416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390432.851588:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098028672:0@lo:400:kworker.0 00000100:00100000:0.0:1788390432.851624:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098028416:12345-0@lo:400:kworker.0 Request processed in 47us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390432.851632:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788390432.851633:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098028416:0@lo:400:kworker.0 00010000:00010000:0.0:1788390432.913501:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390433.937641:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390434.961624:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390435.092303:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390435.092405:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390435.092425:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088518784 00000100:00100000:0.0:1788390435.092439:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088518784 00000100:00100000:3.0:1788390435.092447:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390435.092495:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390435.092515:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088518912 00000100:00100000:0.0:1788390435.092520:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088518912 00000100:00100000:3.0:1788390435.092534:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390435.092562:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088519296 00000100:00100000:0.0:1788390435.092567:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088519296 00000100:00100000:3.0:1788390435.092575:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390435.092592:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088519168 00000100:00100000:0.0:1788390435.092597:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088519168 00000100:00080000:3.0:1788390435.092602:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788390435.092611:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390435.092625:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 177 00000100:00100000:3.0:1788390435.092648:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 178 00000100:00100000:0.0:1788390435.092649:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2406:x1875263088518784:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390435.092734:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2406:x1875263088518784:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 98us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390435.092742:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 177 00000100:00100000:0.0:1788390435.092764:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 179 00000100:00100000:0.0:1788390435.092778:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2406:x1875263088519296:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390435.092809:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2406:x1875263088519296:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 39us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390435.092816:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 179 00000100:00100000:0.0:1788390435.092830:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 180 00000100:00100000:0.0:1788390435.092837:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088519168:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390435.092880:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088519168:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 43us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390435.092886:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 180 00000100:00100000:2.0:1788390435.093025:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088518656 00000100:00100000:2.0:1788390435.093030:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088518656 00000100:00100000:2.0:1788390435.093073:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 357 00000100:00100000:2.0:1788390435.093080:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088518656:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390435.093107:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088518656:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 29us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390435.093114:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 357 00000100:00100000:1.0:1788390435.093461:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088519040 00000100:00100000:1.0:1788390435.093473:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088519040 00000100:00100000:1.0:1788390435.093549:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 58 00000100:00100000:1.0:1788390435.093559:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2406:x1875263088519040:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390435.093634:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2406:x1875263088519040:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 76us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390435.093642:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 58 00000100:00100000:3.0:1788390435.093793:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088518912:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390435.093889:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088518912:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 102us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390435.093897:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 178 00000100:00080000:2.0:1788390435.094359:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390435.409871:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390435.409897:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098030080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788390435.409987:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390435.410103:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098030080 00000100:00100000:3.0:1788390435.410113:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098030080 00000100:00100000:3.0:1788390435.410276:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788390435.410288:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098030080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788390435.410368:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788390435.410457:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098030080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390435.410465:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788390435.410555:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098030080:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788390435.985489:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390437.009564:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390437.457708:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390437.457732:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098030336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390437.457787:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098030208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390437.457821:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390437.457832:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390437.457915:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098030336 00000100:00100000:3.0:1788390437.457923:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098030336 00000100:00100000:0.0:1788390437.457930:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390437.457942:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390437.458030:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098030208 00000100:00100000:2.0:1788390437.458034:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098030208 00000100:00100000:2.0:1788390437.458074:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788390437.458085:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098030208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788390437.458115:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390437.458174:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788390437.458182:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098030336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788390437.458206:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:1.0:1788390437.459021:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390437.459118:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390437.459148:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098030208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1062us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390437.459157:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788390437.459176:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098030464 00000100:00100000:2.0:1788390437.459181:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098030464 00000100:00100000:2.0:1788390437.459214:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788390437.459220:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098030464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390437.459234:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390437.459265:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098030464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390437.459270:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788390437.459287:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390437.459622:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098030336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1440us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390437.459632:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788390437.459670:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390437.459694:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098030336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390437.459891:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098030208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390437.969823:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098030592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390437.969896:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390437.970228:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098030592 00000100:00100000:3.0:1788390437.970236:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098030592 00000100:00100000:3.0:1788390437.970289:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788390437.970300:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098030592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390437.970346:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390437.970394:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098030592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390437.970400:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788390437.970571:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098030848:0@lo:400:kworker.0 00000100:00100000:3.0:1788390437.970595:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390437.970610:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390437.970613:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098030976:0@lo:400:kworker.0 00000100:00100000:3.0:1788390437.970626:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390437.970665:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098030976 00000100:00100000:3.0:1788390437.970668:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098030976 00000100:00100000:3.0:1788390437.970687:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788390437.970691:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098030976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390437.970719:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098030976:12345-0@lo:400:kworker.0 Request processed in 28us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390437.970723:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788390437.970745:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098030976:0@lo:400:kworker.0 00000100:00100000:2.0:1788390437.970855:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098031488:0@lo:400:kworker.0 00000100:00100000:2.0:1788390437.970876:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390437.970891:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390437.970894:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098031360:0@lo:400:kworker.0 00000100:00100000:2.0:1788390437.970904:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390437.970920:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098030848 00000100:00100000:2.0:1788390437.970922:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098030848 00000100:00100000:2.0:1788390437.970941:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098031488 00000100:00100000:2.0:1788390437.970948:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098031488 00000100:00100000:2.0:1788390437.970962:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098031360 00000100:00100000:2.0:1788390437.970964:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098031360 00000100:00100000:2.0:1788390437.970972:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788390437.970976:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098030848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390437.970997:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098030848:12345-0@lo:400:kworker.0 Request processed in 21us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390437.971001:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788390437.971008:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788390437.971011:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098031488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390437.971029:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098031488:12345-0@lo:400:kworker.0 Request processed in 18us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390437.971033:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788390437.971039:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788390437.971042:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098031360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390437.971055:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098031360:12345-0@lo:400:kworker.0 Request processed in 13us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390437.971058:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00010000:00080000:2.0:1788390437.971081:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741b800 x1875263098031360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390437.971089:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098031360:0@lo:400:kworker.0 00000100:00100000:2.0:1788390437.971095:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098031488:0@lo:400:kworker.0 00000100:00100000:1.0:1788390437.971456:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098030720:0@lo:400:kworker.0 00000100:00100000:1.0:1788390437.971490:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390437.971610:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788390437.971615:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390437.971618:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390437.971630:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098031104:0@lo:400:kworker.0 00000100:00100000:2.0:1788390437.971734:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098030720 00000100:00100000:2.0:1788390437.971739:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098030720 00000100:00100000:2.0:1788390437.971775:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788390437.971783:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098030720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390437.971858:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098031872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788390437.973860:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390437.973920:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098031616:0@lo:400:kworker.0 00000100:00100000:0.0:1788390437.973950:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788390437.973983:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87aa1c00 x1875263098030592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390437.974003:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098030592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390437.974040:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098031104 00000100:00100000:0.0:1788390437.974045:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098031104 00000100:00100000:0.0:1788390437.974090:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098031616 00000100:00100000:0.0:1788390437.974093:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098031616 00000100:00100000:0.0:1788390437.974118:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788390437.974136:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098031104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390437.974180:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098031104:12345-0@lo:400:kworker.0 Request processed in 55us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390437.974187:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788390437.974205:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788390437.974211:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098031616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390437.974233:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098031616:12345-0@lo:400:kworker.0 Request processed in 22us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390437.974238:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1788390437.974263:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390437.974280:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098031104:0@lo:400:kworker.0 00010000:00080000:0.0:1788390437.974303:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87949c00 x1875263098031616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390437.974311:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098031616:0@lo:400:kworker.0 00000100:00100000:1.0:1788390437.974541:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098031232:0@lo:400:kworker.0 00000100:00100000:1.0:1788390437.974570:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390437.974586:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098031744:0@lo:400:kworker.0 00000100:00100000:1.0:1788390437.974605:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390437.974636:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098031744 00000100:00100000:1.0:1788390437.974640:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098031744 00000100:00100000:1.0:1788390437.974670:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788390437.974675:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098031744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390437.974708:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098031744:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390437.974714:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788390437.974740:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87948000 x1875263098031744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390437.974749:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098031744:0@lo:400:kworker.0 00000100:00100000:0.0:1788390437.974825:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098031232 00000100:00100000:0.0:1788390437.974829:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098031232 00000100:00100000:0.0:1788390437.974863:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788390437.974871:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098031232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390437.974909:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098031232:12345-0@lo:400:kworker.0 Request processed in 40us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390437.974915:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1788390437.974932:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390437.974935:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390437.975083:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098030720:12345-0@lo:400:kworker.0 Request processed in 3298us (3589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390437.975092:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788390437.975186:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098030720:0@lo:400:kworker.0 00000100:00100000:1.0:1788390437.975197:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098031232:0@lo:400:kworker.0 00000100:00100000:3.0:1788390437.975260:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390437.975402:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098030848:0@lo:400:kworker.0 00000100:00100000:2.0:1788390437.975461:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098031872 00000100:00100000:2.0:1788390437.975466:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098031872 00000100:00100000:2.0:1788390437.975589:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788390437.975597:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098031872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788390437.975612:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390437.975659:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098031872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390437.975665:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1788390437.975724:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87949f80 x1875263098031872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390437.975739:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098031872:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788390438.033665:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390439.057721:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390440.082227:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390440.213601:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390440.213638:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390440.213661:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390440.213686:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088519680 00000100:00100000:2.0:1788390440.213695:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088519680 00000100:00100000:2.0:1788390440.213824:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088519552 00000100:00100000:0.0:1788390440.213827:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088519424 00000100:00100000:2.0:1788390440.213828:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088519552 00000100:00100000:0.0:1788390440.213831:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088519424 00000100:00100000:2.0:1788390440.213855:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 187 00000100:00100000:0.0:1788390440.213856:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 359 00000100:00100000:2.0:1788390440.213864:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088519680:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390440.213864:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088519424:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390440.213937:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088519680:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 73us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.213945:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 187 00000100:00100000:2.0:1788390440.213963:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 188 00000100:00100000:2.0:1788390440.213969:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088519552:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390440.216571:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088519552:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 2593us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390440.216571:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088519424:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 2700us (2969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390440.216584:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 359 00000100:00100000:2.0:1788390440.216585:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 188 00000100:00080000:2.0:1788390440.216628:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390440.216635:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788390440.219261:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390440.219359:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390440.219401:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088519808 00000100:00100000:2.0:1788390440.219412:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088519808 00000100:00100000:2.0:1788390440.219482:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 27 00000100:00100000:2.0:1788390440.219493:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2403:x1875263088519808:12345-192.168.202.11@tcp:9:kworker.0 00000020:00000080:2.0:1788390440.219524:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be977d5 00000100:00080000:2.0:1788390440.219534:0:8408:0:(import.c:65:import_set_state_nolock()) ffff984e878f4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788390440.219581:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788390440.219876:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+2:2403:x1875263088519808:12345-192.168.202.11@tcp:9:kworker.0 Request processed in 383us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.219884:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 27 00000100:00080000:2.0:1788390440.219907:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788390440.219920:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390440.220661:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088520064 00000100:00100000:3.0:1788390440.220670:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088520064 00000100:00100000:3.0:1788390440.220771:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 189 00000100:00100000:3.0:1788390440.220781:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088520064:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390440.220832:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088520064:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 52us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390440.220839:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 189 00000100:00080000:2.0:1788390440.222837:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390440.224895:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390440.225035:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088519936 00000100:00100000:2.0:1788390440.225046:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088519936 00000100:00080000:0.0:1788390440.225134:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390440.225161:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 190 00000100:00100000:2.0:1788390440.225172:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2406:x1875263088519936:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390440.225258:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2406:x1875263088519936:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390440.225266:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 190 00000040:00080000:2.0:1788390440.274126:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788390440.279040:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788390440.529751:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390440.529786:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098032000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390440.529853:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390440.529976:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098032000 00000100:00100000:3.0:1788390440.529985:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098032000 00000100:00100000:3.0:1788390440.530044:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788390440.530055:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098032000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788390440.530090:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788390440.530157:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098032000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390440.530173:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788390440.530676:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098032000:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788390441.105536:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390442.129928:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390442.577600:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390442.577619:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098032128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390442.577679:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390442.577762:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098032128 00000100:00100000:2.0:1788390442.577769:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098032128 00000100:00100000:2.0:1788390442.577822:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788390442.577830:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098032128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788390442.577854:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788390442.577860:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390442.577917:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098032128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390442.577926:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788390442.577964:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098032128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390442.579158:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390442.579174:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098032256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788390442.579228:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390442.579253:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098032384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390442.579281:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390442.579304:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098032384 00000100:00100000:0.0:1788390442.579311:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098032384 00000100:00100000:0.0:1788390442.579381:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788390442.579389:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390442.579390:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098032384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390442.579409:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390442.579458:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098032384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390442.579482:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098032384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390442.579483:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788390442.579562:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098032256 00000100:00100000:2.0:1788390442.579566:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098032256 00000100:00100000:2.0:1788390442.579643:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788390442.579651:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098032256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788390442.579674:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788390442.579723:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098032256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390442.579730:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788390442.579802:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098032256:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788390442.900811:0:14027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:07:21 (1788390441) 00000100:00100000:3.0:1788390443.089480:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390443.089500:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098032512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390443.089513:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390443.089526:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098032640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390443.089565:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390443.089630:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098032512 00000100:00100000:3.0:1788390443.089635:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098032512 00000100:00100000:3.0:1788390443.089677:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788390443.089685:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098032512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390443.089711:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390443.089733:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390443.089772:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098032512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390443.089776:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098032640 00000100:00100000:2.0:1788390443.089781:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098032640 00000100:00100000:3.0:1788390443.089782:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788390443.089809:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390443.089821:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788390443.089829:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098032640:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788390443.089841:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87aa0a80 x1875263098032512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390443.089861:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098032512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390443.090206:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098032768:0@lo:400:kworker.0 00000100:00100000:0.0:1788390443.090234:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788390443.090294:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390443.090364:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098032768 00000100:00100000:3.0:1788390443.090368:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098032768 00000100:00100000:3.0:1788390443.090390:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788390443.090394:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098032768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390443.093187:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098032768:12345-0@lo:400:kworker.0 Request processed in 2779us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390443.093187:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098032640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3346us (3442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390443.093203:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788390443.093205:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788390443.093278:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098032896:0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.093290:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098033152:0@lo:400:kworker.0 00000100:00100000:3.0:1788390443.093340:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390443.093355:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098033024:0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.093388:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390443.093394:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390443.093418:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098032896 00000100:00100000:3.0:1788390443.093424:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098032896 00000100:00100000:3.0:1788390443.093454:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098033152 00000100:00100000:3.0:1788390443.093456:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098033152 00000100:00100000:3.0:1788390443.093467:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788390443.093472:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098032896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390443.093509:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098032896:12345-0@lo:400:kworker.0 Request processed in 38us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390443.093513:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788390443.093521:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788390443.093524:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098033152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390443.093541:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098033152:12345-0@lo:400:kworker.0 Request processed in 17us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390443.093545:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788390443.093573:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098033152:0@lo:400:kworker.0 00000100:00100000:3.0:1788390443.093589:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098032896:0@lo:400:kworker.0 00000100:00100000:0.0:1788390443.093696:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098032768:0@lo:400:kworker.0 00010000:00080000:0.0:1788390443.093709:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87948000 x1875263098032640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390443.093723:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098032640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390443.093937:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098033536:0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.093960:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390443.093984:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390443.093989:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098033408:0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.094006:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390443.094027:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098033536 00000100:00100000:2.0:1788390443.094030:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098033536 00000100:00100000:2.0:1788390443.094055:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098033408 00000100:00100000:2.0:1788390443.094058:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098033408 00000100:00100000:2.0:1788390443.094072:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788390443.094090:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098033536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390443.094099:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098033280:0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.094128:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098033536:12345-0@lo:400:kworker.0 Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390443.094135:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390443.094138:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788390443.094155:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098033280 00000100:00100000:0.0:1788390443.094158:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390443.094159:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098033280 00000100:00100000:0.0:1788390443.094165:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098033664:0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.094179:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788390443.094184:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390443.094189:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098033408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390443.094206:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098033664 00000100:00100000:0.0:1788390443.094210:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098033664 00000100:00100000:2.0:1788390443.094223:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098033408:12345-0@lo:400:kworker.0 Request processed in 37us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390443.094234:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788390443.094316:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098033024 00000100:00100000:3.0:1788390443.094336:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098033024 00000100:00100000:3.0:1788390443.094358:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788390443.094362:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098033024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390443.094386:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098033024:12345-0@lo:400:kworker.0 Request processed in 25us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390443.094391:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788390443.094448:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098033280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390443.094480:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098033280:12345-0@lo:400:kworker.0 Request processed in 34us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390443.094765:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788390443.094783:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788390443.094789:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098033664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.094819:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098033664:12345-0@lo:400:kworker.0 Request processed in 31us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390443.094824:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00080000:2.0:1788390443.095676:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb21ad80 x1875263098033408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390443.095692:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098033408:0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.095706:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098033536:0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.095716:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098033024:0@lo:400:kworker.0 00000100:00080000:2.0:1788390443.095759:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788390443.095764:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788390443.095790:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb21b800 x1875263098033664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390443.095799:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098033664:0@lo:400:kworker.0 00000100:00100000:2.0:1788390443.095808:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098033280:0@lo:400:kworker.0 00000100:00100000:0.0:1788390443.098812:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00010000:0.0:1788390443.153983:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390443.823424:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390443.823528:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088520192 00000100:00100000:2.0:1788390443.823538:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088520192 00000100:00100000:2.0:1788390443.823629:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:2.0:1788390443.823642:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:11087:x1875263088520192:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390443.823666:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390443.823695:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be978b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d61 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390443.823778:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be978bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390443.823793:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be978bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390443.823809:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be978bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390443.823857:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788390443.823861:0:8996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390443.823897:0:8996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be978bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390443.823922:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be978b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d61 expref: 7 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390443.823940:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be978bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d61 expref: 6 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390443.823949:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933800) 00010000:00010000:2.0:1788390443.823952:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390443.823956:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:2.0:1788390443.824018:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:11087:x1875263088520192:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 379us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390443.824025:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00080000:3.0:1788390443.824121:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390443.827647:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390443.827763:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088520320 00000100:00100000:1.0:1788390443.827786:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088520320 00000100:00100000:1.0:1788390443.827846:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00100000:1.0:1788390443.827855:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:11088:x1875263088520320:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390443.827872:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390443.827889:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be978c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d68 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.827953:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.827966:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.827978:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.827994:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828018:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828025:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828095:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5200/0xe156d0713be978d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828102:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5200/0xe156d0713be978d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828107:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5200/0xe156d0713be978d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390443.828148:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788390443.828153:0:12122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390443.828175:0:12122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5200/0xe156d0713be978d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828184:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828189:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828193:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828197:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390443.828200:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828211:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828221:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933800) 00010000:00010000:1.0:1788390443.828223:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390443.828226:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828230:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be978ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828241:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828244:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828248:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828251:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390443.828252:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828255:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828259:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff984fba803900) 00010000:00010000:1.0:1788390443.828260:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390443.828261:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828270:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be978d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828293:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be978c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d68 expref: 8 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828302:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5200/0xe156d0713be978d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d68 expref: 7 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390443.828306:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984fba803200) 00010000:00010000:1.0:1788390443.828308:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390443.828309:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5200, rc 0) 00000100:00100000:1.0:1788390443.828411:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:11088:x1875263088520320:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 555us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390443.828417:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00100000:0.0:1788390443.831471:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390443.831563:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088520448 00000100:00100000:3.0:1788390443.831722:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088520448 00000100:00100000:3.0:1788390443.831786:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:3.0:1788390443.831799:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:11088:x1875263088520448:12345-192.168.202.11@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788390443.831965:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:11088:x1875263088520448:12345-192.168.202.11@tcp:900:lhsmtool_posix.0 Request processed in 169us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390443.831974:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:3.0:1788390443.834755:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390443.834990:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088520704 00000100:00100000:0.0:1788390443.835015:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088520704 00000100:00100000:0.0:1788390443.835096:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 41 00000100:00100000:0.0:1788390443.835107:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:11088:x1875263088520704:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390443.835128:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390443.835149:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be978df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d6f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.835223:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.835236:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.835248:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.835283:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.835291:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.835297:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.835993:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be978f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836006:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be978f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836015:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be978f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390443.836034:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788390443.836138:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836146:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836153:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836158:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390443.836163:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836172:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836185:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984fba803200) 00010000:00010000:0.0:1788390443.836188:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390443.836193:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836199:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be978e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836212:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836218:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836234:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836239:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390443.836242:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836249:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836257:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff984f86567a00) 00010000:00010000:0.0:1788390443.836260:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390443.836263:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.836268:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be978ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.837155:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be978df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d6f expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.837173:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be978f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d6f expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390443.837181:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:0.0:1788390443.837183:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390443.837186:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80600, rc 0) 00000100:00100000:0.0:1788390443.837269:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:11088:x1875263088520704:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 2162us (2523us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788390443.837288:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 41 00000100:00100000:0.0:1788390443.841737:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390443.842524:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088520832 00000100:00100000:2.0:1788390443.842535:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088520832 00000100:00100000:2.0:1788390443.842717:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 42 00000100:00100000:2.0:1788390443.842728:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:11088:x1875263088520832:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788390443.842940:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:11088:x1875263088520832:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 Request processed in 211us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390443.842948:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 42 00000100:00100000:2.0:1788390443.844703:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390443.844816:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088520960 00000100:00100000:1.0:1788390443.844828:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088520960 00000100:00080000:3.0:1788390443.844936:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390443.844980:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 43 00000100:00100000:1.0:1788390443.844992:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:11088:x1875263088520960:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788390443.849446:0:12122:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4417us 00000100:00100000:2.0:1788390443.861637:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:11088:x1875263088520960:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 Request processed in 16636us (16929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390443.861651:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 43 00010000:00010000:2.0:1788390444.177453:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390444.373775:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788390444.374664:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788390445.080790:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390445.081627:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088521088 00000100:00100000:1.0:1788390445.081640:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088521088 00000100:00100000:1.0:1788390445.081710:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 44 00000100:00100000:1.0:1788390445.081722:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:11130:x1875263088521088:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390445.081742:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390445.081768:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d76 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081843:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081856:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081869:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081883:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081889:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081896:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081948:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081955:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081962:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081968:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390445.081973:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.081991:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082006:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933800) 00010000:00010000:1.0:1788390445.082009:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390445.082014:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082021:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082032:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082038:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082044:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082049:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390445.082052:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082058:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082074:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff984fba803900) 00010000:00010000:1.0:1788390445.082077:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390445.082079:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082094:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be97910 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082126:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97902 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d76 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082138:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933800) 00010000:00010000:1.0:1788390445.082140:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390445.082144:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d76 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.082153:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5a00, rc 0) 00000100:00100000:1.0:1788390445.082221:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:11130:x1875263088521088:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 501us (1440us total) trans 0 rc 301/301 00000100:00100000:1.0:1788390445.082228:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 44 00000100:00080000:0.0:1788390445.083485:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390445.094232:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.096467:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088521344 00000100:00100000:2.0:1788390445.096481:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088521344 00000100:00100000:2.0:1788390445.096593:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:2.0:1788390445.096606:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:11130:x1875263088521344:12345-192.168.202.11@tcp:36:lfs.0 00010000:00010000:2.0:1788390445.096664:0:8996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390445.096695:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be978bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d61 expref: 9 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.096712:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933800) 00010000:00010000:2.0:1788390445.096726:0:8996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390445.096791:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.096806:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.096815:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.096841:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.096849:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.096856:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097814:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097826:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097835:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390445.097850:0:8996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a863addd reply state 00000000dc4f1e01 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097859:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097866:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:3.0:1788390445.097869:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390445.097881:0:8996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788390445.097886:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788390445.097894:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097900:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097906:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097911:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390445.097915:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097923:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097931:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984f8c933000) 00010000:00010000:3.0:1788390445.097934:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390445.097937:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097943:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97917 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390445.097959:0:8996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a863addd reply state 00000000dc4f1e01 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097967:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.097972:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff984f8c933900) 00010000:00010000:3.0:1788390445.097980:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390445.097982:0:8996:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788390445.098096:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:11130:x1875263088521344:12345-192.168.202.11@tcp:36:lfs.0 Request processed in 1491us (3872us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788390445.098104:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:1.0:1788390445.186728:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.187650:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088521472 00000100:00100000:2.0:1788390445.187662:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088521472 00000100:00100000:3.0:1788390445.188114:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 46 00000100:00100000:3.0:1788390445.188129:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:11138:x1875263088521472:12345-192.168.202.11@tcp:101:lctl.0 00010000:00010000:3.0:1788390445.188158:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390445.188186:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be9792c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d7d expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.188258:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be97933 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.188273:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be97933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.188285:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be97933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390445.188351:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788390445.188356:0:12122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390445.188412:0:12122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be97933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.188438:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be9792c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d7d expref: 12 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.188457:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be97933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d7d expref: 11 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.188485:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:3.0:1788390445.188488:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390445.188492:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63c200, rc 0) 00000100:00100000:3.0:1788390445.188572:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:11138:x1875263088521472:12345-192.168.202.11@tcp:101:lctl.0 Request processed in 446us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390445.188580:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 46 00010000:00010000:0.0:1788390445.201738:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390445.232836:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390445.232939:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088521600 00000100:00100000:3.0:1788390445.232950:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088521600 00000100:00100000:3.0:1788390445.233016:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:3.0:1788390445.233027:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:11144:x1875263088521600:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390445.233047:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390445.233085:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be9793a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d84 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233175:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233194:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233208:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233233:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233242:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233271:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233525:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f80030600/0xe156d0713be9794f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233534:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f80030600/0xe156d0713be9794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233541:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f80030600/0xe156d0713be9794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390445.233646:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788390445.233651:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390445.233695:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f80030600/0xe156d0713be9794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233710:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233716:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233723:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233730:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63c400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390445.233734:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233742:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233764:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:3.0:1788390445.233767:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390445.233772:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233779:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233794:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233801:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233807:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233813:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63dc00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390445.233816:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233822:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233913:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff984f8c933900) 00010000:00010000:3.0:1788390445.233916:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390445.233920:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233928:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97948 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233969:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be9793a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d84 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233982:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f80030600/0xe156d0713be9794f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d84 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.233990:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:3.0:1788390445.233992:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788390445.233994:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f80030600, rc 0) 00000100:00100000:3.0:1788390445.234079:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+12:11144:x1875263088521600:12345-192.168.202.11@tcp:101:bash.0 Request processed in 1053us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390445.234088:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:0.0:1788390445.243547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390445.243652:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088521856 00000100:00100000:1.0:1788390445.243663:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088521856 00000100:00100000:1.0:1788390445.243729:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 48 00000100:00100000:1.0:1788390445.243740:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+12:11144:x1875263088521856:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:1.0:1788390445.243761:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390445.243781:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97956 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d8b expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.243902:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.243930:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.243942:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.243997:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.244006:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.244012:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788390445.244368:0:8996:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788390445.244469:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.244479:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.244486:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.244518:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.244525:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.244531:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.244542:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390445.244546:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.244553:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.245865:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:1.0:1788390445.245868:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390445.245872:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.245877:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9795d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390445.245895:0:8996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099ec59da reply state 000000005d923083 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.245906:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.245913:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fba803900) 00010000:00010000:1.0:1788390445.245915:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788390445.245918:0:8996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788390445.245961:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97956 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d8b expref: 15 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.245976:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d8b expref: 14 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.246004:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fba803f00) 00010000:00010000:1.0:1788390445.246007:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390445.246009:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5e00, rc 0) 00000100:00100000:1.0:1788390445.246760:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:11144:x1875263088521856:12345-192.168.202.11@tcp:101:bash.0 Request processed in 3019us (3220us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788390445.246766:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 48 00000100:00100000:1.0:1788390445.252173:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.252845:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088521984 00000100:00100000:2.0:1788390445.252857:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088521984 00000100:00100000:2.0:1788390445.252953:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:2.0:1788390445.252962:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1875263088521984:12345-192.168.202.11@tcp:8:bash.0 00010000:00080000:2.0:1788390445.252998:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1788390445.253041:0:8409:0:(genops.c:1385:class_connect()) connect: client 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa, cookie 0xe156d0713be97979 00002000:00100000:2.0:1788390445.253052:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa/ffff984e88235000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788390445.253077:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788390445.253150:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788390445.253177:0:8409:0:(import.c:65:import_set_state_nolock()) ffff984e88233800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390445.253258:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2403:x1875263088521984:12345-192.168.202.11@tcp:8:bash.0 Request processed in 295us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390445.253265:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:0.0:1788390445.255532:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.255750:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088522112 00000100:00100000:2.0:1788390445.255761:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088522112 00000100:00100000:2.0:1788390445.255835:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00100000:2.0:1788390445.255858:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:0:x1875263088522112:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390445.255875:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390445.256012:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d92 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390445.256041:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390445.256071:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=265s v=(0 0) 00010000:00010000:2.0:1788390445.256075:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390445.256085:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d92 expref: 7 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.256107:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d92 expref: 7 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.256123:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:2.0:1788390445.256183:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:0:x1875263088522112:12345-192.168.202.11@tcp:101:bash.0 Request processed in 327us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390445.256190:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00080000:0.0:1788390445.256723:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390445.260654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390445.260776:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088522240 00000100:00100000:0.0:1788390445.260784:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088522240 00000100:00100000:0.0:1788390445.260834:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 30 00000100:00100000:0.0:1788390445.260841:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:11144:x1875263088522240:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:0.0:1788390445.260857:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390445.260874:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243d99 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.260903:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d92 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.260914:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390445.260918:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390445.260924:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.260959:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d92 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.260989:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d92 expref: 8 pid: 8408 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390445.261000:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1875263098033792:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390445.261108:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071480 going to sleep for 11 seconds 00000100:00100000:0.0:1788390445.269495:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1875263098033792:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390445.269535:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.269553:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81000, rc 0) 00000100:00100000:0.0:1788390445.269647:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:11144:x1875263088522240:12345-192.168.202.11@tcp:101:bash.0 Request processed in 8805us (8999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.269654:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 30 00000100:00100000:2.0:1788390445.272169:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390445.272417:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088522368 00000100:00100000:0.0:1788390445.272426:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088522368 00010000:00010000:0.0:1788390445.272464:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d92 expref: 8 pid: 8408 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390445.272622:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:0.0:1788390445.272632:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088522368:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390445.272645:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390445.272665:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d92 expref: 8 pid: 8408 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.272696:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d92 expref: 8 pid: 8408 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.272721:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be97980 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d92 expref: 8 pid: 8408 timeout: 365 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.272739:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390445.272744:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390445.272751:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.272760:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.272793:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390445.272807:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6477:1875263098033920:192.168.202.11@tcp:105: 00000100:00100000:0.0:1788390445.272921:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071480 going to sleep for 11 seconds 00000100:00100000:0.0:1788390445.275762:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b47800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6477:1875263098033920:192.168.202.11@tcp:105: 00010000:00010000:0.0:1788390445.275786:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390445.275876:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088522368:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 3244us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.275886:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:1.0:1788390445.278903:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.279000:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088522624 00000100:00100000:2.0:1788390445.279010:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088522624 00000100:00100000:2.0:1788390445.279129:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:2.0:1788390445.279141:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:11144:x1875263088522624:12345-192.168.202.11@tcp:35:bash.0 00000100:00100000:2.0:1788390445.283855:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:11144:x1875263088522624:12345-192.168.202.11@tcp:35:bash.0 Request processed in 4706us (4952us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788390445.283869:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:2.0:1788390445.332901:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.332946:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.332976:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.333010:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.333049:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088523008 00000100:00100000:1.0:1788390445.333058:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088522880 00000100:00100000:2.0:1788390445.333067:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088523008 00000100:00100000:1.0:1788390445.333072:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088522880 00000100:00100000:3.0:1788390445.333121:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088523136 00000100:00100000:3.0:1788390445.333125:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088523136 00000100:00100000:2.0:1788390445.333128:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 197 00000100:00100000:2.0:1788390445.333137:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088523008:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390445.333183:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088522752 00000100:00100000:0.0:1788390445.333188:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088522752 00000100:00100000:0.0:1788390445.333220:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 361 00000100:00100000:0.0:1788390445.333227:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2404:x1875263088522752:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390445.333294:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2404:x1875263088522752:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 67us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.333302:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 361 00000100:00100000:2.0:1788390445.333582:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088523008:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 444us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390445.333589:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 197 00000100:00100000:1.0:1788390445.333669:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 198 00000100:00100000:1.0:1788390445.333677:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088522880:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390445.333724:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088522880:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 48us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390445.333731:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 198 00000100:00100000:2.0:1788390445.334501:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 199 00000100:00100000:2.0:1788390445.334510:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088523136:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390445.334669:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088523136:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 159us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390445.334677:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 199 00000100:00080000:0.0:1788390445.336881:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788390445.336892:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390445.341760:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390445.341898:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088523392 00000100:00100000:0.0:1788390445.341909:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088523392 00000100:00100000:0.0:1788390445.342002:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 49 00000100:00100000:0.0:1788390445.342014:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:11154:x1875263088523392:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390445.342038:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390445.342079:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be9798e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243da0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390445.342200:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788390445.342522:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be9798e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243da0 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.342538:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:0.0:1788390445.342541:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390445.342546:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be9798e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243da0 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.342621:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81400, rc 0) 00000100:00100000:0.0:1788390445.342719:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:11154:x1875263088523392:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 707us (970us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1788390445.342740:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 49 00000100:00100000:3.0:1788390445.346898:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.347647:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088523648 00000100:00100000:2.0:1788390445.347658:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088523648 00000100:00100000:2.0:1788390445.347803:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:2.0:1788390445.347815:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:11154:x1875263088523648:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:2.0:1788390445.348070:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:11154:x1875263088523648:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 249us (1174us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788390445.348078:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:2.0:1788390445.400575:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390445.400717:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088523776 00000100:00100000:1.0:1788390445.400727:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088523776 00000100:00100000:1.0:1788390445.400794:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00100000:1.0:1788390445.400805:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:11160:x1875263088523776:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390445.400828:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390445.400851:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be9799c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243da7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.400918:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be979a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.400948:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be979a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.400960:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be979a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390445.401002:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788390445.401005:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390445.401025:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be979a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.401052:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be9799c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243da7 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.401083:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be979a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243da7 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.401093:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:1.0:1788390445.401096:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390445.401099:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4400, rc 0) 00000100:00100000:1.0:1788390445.401164:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:11160:x1875263088523776:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 361us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390445.401171:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00100000:0.0:1788390445.405863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.406221:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088524032 00000100:00100000:2.0:1788390445.406244:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088524032 00000100:00100000:2.0:1788390445.406302:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:2.0:1788390445.406312:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:11160:x1875263088524032:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390445.406354:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390445.406375:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243dae expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.406481:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be979b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.406494:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be979b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.406506:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be979b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390445.406517:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788390445.406735:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dae expref: 22 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.406752:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be979b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dae expref: 21 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.406761:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fba803f00) 00010000:00010000:2.0:1788390445.406764:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390445.406768:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:2.0:1788390445.406820:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:11160:x1875263088524032:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 509us (967us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788390445.406827:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:0.0:1788390445.409772:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390445.409823:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.409893:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088524288 00000100:00100000:2.0:1788390445.409903:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088524288 00000100:00100000:2.0:1788390445.409964:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:2.0:1788390445.409975:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:11160:x1875263088524288:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390445.409997:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390445.410015:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be979bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243db5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.410126:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be979c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.410141:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be979c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.410152:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be979c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390445.410163:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788390445.410248:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be979bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243db5 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.410264:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be979c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243db5 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.410272:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fba803f00) 00010000:00010000:2.0:1788390445.410275:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788390445.410278:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5a00, rc 0) 00000100:00100000:2.0:1788390445.410370:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:11160:x1875263088524288:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 397us (606us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788390445.410391:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:1.0:1788390445.410471:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088524416 00000100:00100000:1.0:1788390445.410476:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088524416 00000100:00100000:1.0:1788390445.410517:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:1.0:1788390445.410524:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:2406:x1875263088524416:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390445.410533:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390445.410552:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be979b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dae expref: 23 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.410566:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fba803f00) 00010000:00010000:1.0:1788390445.410570:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390445.410593:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:2406:x1875263088524416:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 69us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390445.410599:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:0.0:1788390445.415655:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390445.415932:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088524544 00000100:00100000:3.0:1788390445.415943:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088524544 00000100:00100000:3.0:1788390445.416006:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:3.0:1788390445.416020:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088524544:12345-192.168.202.11@tcp:1:lfs.0 00010000:00010000:3.0:1788390445.416079:0:8798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.416102:0:8798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.416130:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390445.416135:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390445.416141:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.416175:0:8798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.416191:0:8798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 7 pid: 8407 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390445.416207:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8798:1875263098034048:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390445.416315:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90f669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390445.417790:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8798:1875263098034048:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390445.417826:0:8798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390445.418407:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.418482:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088524672 00000100:00100000:2.0:1788390445.418490:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088524672 00002000:00100000:2.0:1788390445.418535:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff984e868c5f80 x1875263088524672/t0(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:61/0 lens 504/0 e 0 to 0 dl 1788390456 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788390445.418545:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e868c5f80 with x1875263088524672 ext(0->12) 00010000:00010000:2.0:1788390445.418553:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 8 pid: 8407 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.418567:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 8 pid: 8407 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390445.418574:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff984e868c5f80 00000100:00100000:2.0:1788390445.418604:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:2.0:1788390445.418612:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088524672:12345-192.168.202.11@tcp:4:lfs.0 00000001:00100000:0.0:1788390445.420710:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000100:00100000:2.0:1788390445.424991:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088524672:12345-192.168.202.11@tcp:4:lfs.0 Request processed in 6367us (6574us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788390445.425005:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 0 00002000:00100000:2.0:1788390445.425017:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff984e868c5f80 x1875263088524672/t4294967300(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:61/0 lens 504/448 e 0 to 0 dl 1788390456 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788390445.425027:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e868c5f80 with x1875263088524672 ext(0->12) 00010000:00010000:2.0:1788390445.425037:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 9 pid: 8407 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.425078:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 9 pid: 8407 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390445.425086:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff984e868c5f80 00000100:00100000:0.0:1788390445.431169:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.431359:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088524800 00000100:00100000:2.0:1788390445.431369:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088524800 00010000:00010000:2.0:1788390445.431411:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 9 pid: 8407 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390445.431451:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:2.0:1788390445.431462:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2404:x1875263088524800:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390445.431476:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788390445.431495:0:6479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788390445.431498:0:6479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788390445 00002000:00010000:2.0:1788390445.431501:0:6479:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788390445 00002000:00010000:2.0:1788390445.431503:0:6479:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788390445 00002000:00010000:2.0:1788390445.431505:0:6479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788390445.431512:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 9 pid: 8407 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.431528:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 9 pid: 8407 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.431551:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20e3ca8/0xe156d0713be97987 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d99 expref: 9 pid: 8407 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.432311:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390445.432314:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390445.432402:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.432411:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.432441:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390445.432471:0:8798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.432480:0:8798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.432501:0:8798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390445.432511:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088524800:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 1050us (1353us total) trans 0 rc 0/0 00010000:00010000:0.0:1788390445.432511:0:8798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390445.432520:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 53 00010000:00010000:0.0:1788390445.432520:0:8798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.432526:0:8798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80031800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390445.432530:0:8798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.432550:0:8798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.432563:0:8798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.432570:0:8798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082337ef5/0xe156d0713be979d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390445.432615:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088524544:12345-192.168.202.11@tcp:1:lfs.0 Request processed in 16600us (16971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.432624:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:1.0:1788390445.435105:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390445.435484:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088525056 00000100:00100000:3.0:1788390445.435495:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088525056 00000100:00100000:3.0:1788390445.435744:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:3.0:1788390445.435767:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:11160:x1875263088525056:12345-192.168.202.11@tcp:35:lfs.0 00000004:00010000:3.0:1788390445.435830:0:6495:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be979c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243db5 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390445.436254:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788390445.436316:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788390445.436576:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788390445.436610:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.436624:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d8b expref: 26 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.436631:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.436659:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d8b expref: 26 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.436670:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d8b expref: 26 pid: 8996 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390445.436681:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6495:1875263098034176:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390445.436749:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788390445.439831:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6495:1875263098034176:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390445.439844:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00010000:00010000:3.0:1788390445.439867:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390445.439925:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088525184 00000100:00100000:0.0:1788390445.439933:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088525184 00010000:00010000:0.0:1788390445.439972:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d8b expref: 27 pid: 8996 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390445.440011:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 54 00000100:00100000:0.0:1788390445.440021:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:2404:x1875263088525184:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390445.440036:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390445.440044:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d8b expref: 27 pid: 8996 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.440708:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d8b expref: 27 pid: 8996 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.440754:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9796b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d8b expref: 27 pid: 8996 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.440772:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fba803f00) 00010000:00010000:0.0:1788390445.440777:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.440786:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.440794:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.440814:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390445.440873:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+26:2404:x1875263088525184:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 852us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.440892:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 54 00010000:00010000:3.0:1788390445.444479:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.444498:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390445.444621:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788390445.444738:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788390445.444832:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875263098034304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788390445.445004:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390445.445038:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90f669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390445.445073:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098034304 00000100:00100000:2.0:1788390445.445080:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098034304 00000100:00100000:2.0:1788390445.445176:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788390445.445184:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6495:x1875263098034304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788390445.445246:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6495:x1875263098034304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390445.445251:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788390445.445386:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390445.445419:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875263098034304:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788390445.445565:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788390445.445605:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875263098034432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788390445.445630:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390445.445707:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098034432 00000100:00100000:1.0:1788390445.445711:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098034432 00000100:00100000:3.0:1788390445.445714:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390445.445739:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788390445.445745:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1875263098034432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788390445.445825:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6495:x1875263098034432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 80us (194us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788390445.445833:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788390445.445858:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875263098034432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788390445.445950:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788390445.445981:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.445990:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.445997:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.446004:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63cc00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390445.446008:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.446015:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.446042:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fba803f00) 00010000:00010000:3.0:1788390445.446045:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788390445.446049:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390445.446056:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be979db lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390445.446430:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788390445.446489:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788390445.446499:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 266004176896ns, next at 267004175074ns, rc = 0 00000001:00080000:3.0:1788390445.446505:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1788390445.446525:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fba803f00) 00010000:00010000:3.0:1788390445.446529:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788390445.446536:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be979c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243db5 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390445.446638:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:11160:x1875263088525056:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 10885us (11542us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1788390445.446646:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 8 00000020:00080000:3.0:1788390445.446650:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788390445.448949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390445.449002:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088525312 00000100:00100000:0.0:1788390445.449011:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088525312 00000100:00100000:0.0:1788390445.449077:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:0.0:1788390445.449089:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:11160:x1875263088525312:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390445.449110:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390445.449129:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be979e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243dbc expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.449181:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be979e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dbc expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.449354:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be979e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dbc expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.449375:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390445.449379:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390445.449383:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81800, rc 0) 00000100:00100000:0.0:1788390445.449440:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:11160:x1875263088525312:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 353us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.449447:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:0.0:1788390445.451358:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.451459:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088525568 00000100:00100000:2.0:1788390445.451468:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088525568 00000100:00100000:2.0:1788390445.451521:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:2.0:1788390445.451530:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ad0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:11160:x1875263088525568:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:2.0:1788390445.451745:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ad0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+31:11160:x1875263088525568:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 215us (394us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788390445.451768:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:1.0:1788390445.510674:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.510807:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088525824 00000100:00100000:2.0:1788390445.510819:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088525824 00000100:00100000:2.0:1788390445.510874:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 54 00000100:00100000:2.0:1788390445.510929:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+31:11170:x1875263088525824:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390445.510953:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390445.510972:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be979e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243dc3 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390445.511092:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788390445.511198:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be979e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dc3 expref: 33 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.511214:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:2.0:1788390445.511217:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390445.511223:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be979e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dc3 expref: 33 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.511239:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4600, rc 0) 00000100:00100000:2.0:1788390445.511411:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:11170:x1875263088525824:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 527us (744us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788390445.511428:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 54 00000100:00100000:1.0:1788390445.513176:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.513509:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088525952 00000100:00100000:2.0:1788390445.513532:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088525952 00000100:00100000:2.0:1788390445.513653:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 55 00000100:00100000:2.0:1788390445.513664:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:11170:x1875263088525952:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:2.0:1788390445.513755:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513774:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513785:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513795:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513801:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513807:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513877:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513886:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513893:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390445.513950:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513962:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513977:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513983:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.513988:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390445.513991:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514091:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514104:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:2.0:1788390445.514108:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390445.514113:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514119:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be979f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514132:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514138:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514144:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514150:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390445.514159:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514165:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514174:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fba803900) 00010000:00010000:2.0:1788390445.514176:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390445.514179:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514185:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be979fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514195:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514633:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514642:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514647:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390445.514650:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514655:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514663:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390445.514665:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390445.514673:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.514679:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97a05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390445.514884:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:11170:x1875263088525952:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 1220us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390445.514893:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 55 00000100:00100000:0.0:1788390445.516848:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390445.517050:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088526208 00000100:00100000:3.0:1788390445.517072:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088526208 00000100:00100000:3.0:1788390445.517125:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:3.0:1788390445.517136:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:11170:x1875263088526208:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390445.517408:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+33:11170:x1875263088526208:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 273us (568us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788390445.517439:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:1.0:1788390445.545646:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390445.546367:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088526464 00000100:00100000:0.0:1788390445.546381:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088526464 00000100:00100000:0.0:1788390445.546448:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 56 00000100:00100000:0.0:1788390445.546459:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+33:11173:x1875263088526464:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390445.546484:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390445.546505:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97a0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243dca expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546579:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546596:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546608:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546637:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546645:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546652:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546772:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546782:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546789:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390445.546800:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788390445.546879:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546887:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546894:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546900:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390445.546905:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546924:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546938:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390445.546941:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390445.546946:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546952:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97a13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546969:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546975:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546981:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546986:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390445.546990:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.546995:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.547002:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fba803900) 00010000:00010000:0.0:1788390445.547005:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390445.547008:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.547025:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97a1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.547105:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97a0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dca expref: 36 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.547120:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dca expref: 35 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.547128:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390445.547130:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390445.547133:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81400, rc 0) 00000100:00100000:0.0:1788390445.547208:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:11173:x1875263088526464:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 751us (1571us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788390445.547215:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 56 00000100:00100000:1.0:1788390445.550204:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.550310:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088526592 00000100:00100000:2.0:1788390445.550461:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088526592 00000100:00100000:2.0:1788390445.550530:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 57 00000100:00100000:2.0:1788390445.550541:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8803b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+36:11173:x1875263088526592:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:2.0:1788390445.551180:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.551200:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.551212:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.551253:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.551259:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.551267:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.551272:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390445.551291:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.551299:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.551312:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390445.551315:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390445.551342:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.551350:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390445.551824:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8803b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+36:11173:x1875263088526592:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 1282us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390445.551833:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 57 00000100:00100000:2.0:1788390445.555732:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390445.555829:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088526848 00000100:00100000:3.0:1788390445.555839:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088526848 00000100:00100000:3.0:1788390445.555926:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:3.0:1788390445.555938:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:11173:x1875263088526848:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390445.556183:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+36:11173:x1875263088526848:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 246us (461us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788390445.556192:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:0.0:1788390445.652823:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390445.657174:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb7871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098034560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788390445.657253:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390445.657611:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098034560 00000100:00100000:2.0:1788390445.657620:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098034560 00000100:00100000:2.0:1788390445.657763:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788390445.657775:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098034560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390445.657809:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1788390445.657858:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098034560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390445.657865:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788390445.657914:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb7871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098034560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390445.731510:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.731768:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088527104 00000100:00100000:2.0:1788390445.731778:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088527104 00000100:00100000:2.0:1788390445.731837:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 58 00000100:00100000:2.0:1788390445.731848:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+36:11204:x1875263088527104:12345-192.168.202.11@tcp:101:cat.0 00010000:00010000:2.0:1788390445.731888:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390445.731907:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243dd1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.732029:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.732044:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.732067:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390445.732079:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788390445.732203:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd1 expref: 39 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.732222:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd1 expref: 38 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.732230:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390445.732233:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390445.732236:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:2.0:1788390445.732306:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:11204:x1875263088527104:12345-192.168.202.11@tcp:101:cat.0 Request processed in 459us (806us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788390445.732313:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 58 00000100:00100000:1.0:1788390445.735264:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390445.735400:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.735442:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088527488 00000100:00100000:2.0:1788390445.735452:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088527488 00000100:00100000:0.0:1788390445.735522:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088527232 00000100:00100000:0.0:1788390445.735528:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088527232 00000100:00100000:2.0:1788390445.735575:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:2.0:1788390445.735603:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:11204:x1875263088527488:12345-192.168.202.11@tcp:35:cat.0 00000100:00100000:0.0:1788390445.735617:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 4 00000100:00100000:0.0:1788390445.735629:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:2404:x1875263088527232:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390445.735648:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390445.735673:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd1 expref: 39 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.735707:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390445.735713:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390445.735770:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:2404:x1875263088527232:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 144us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.735779:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 4 00000100:00100000:2.0:1788390445.735817:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:11204:x1875263088527488:12345-192.168.202.11@tcp:35:cat.0 Request processed in 217us (415us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788390445.735824:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:0.0:1788390445.779138:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390445.780311:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088527744 00000100:00100000:1.0:1788390445.780351:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088527744 00000100:00100000:1.0:1788390445.780410:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:1.0:1788390445.781164:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:11210:x1875263088527744:12345-192.168.202.11@tcp:101:dd.0 00010000:00010000:1.0:1788390445.781195:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390445.781198:0:8996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788390445.781225:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be979a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243da7 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.781246:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:1.0:1788390445.781251:0:8996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390445.781266:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97a4b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243dd8 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.781430:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.781445:0:8996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dca expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.781455:0:8996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.781494:0:8996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dca expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390445.781509:0:8996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dca expref: 38 pid: 6493 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390445.781522:0:8996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098034688:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390445.781625:0:8996:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390445.786486:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390445.786592:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088527872 00000100:00100000:0.0:1788390445.786603:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088527872 00010000:00010000:0.0:1788390445.786644:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dca expref: 39 pid: 6493 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390445.786690:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 55 00000100:00100000:0.0:1788390445.786701:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:2405:x1875263088527872:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390445.786719:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390445.786727:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dca expref: 39 pid: 6493 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.786742:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dca expref: 39 pid: 6493 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.786766:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390445.786771:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.786780:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.786807:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.786829:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390445.787617:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97a21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dca expref: 39 pid: 6493 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390445.787638:0:8996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098034688:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390445.787660:0:8996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.787669:0:8996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.787675:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390445.787693:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788390445.787841:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be97a4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd8 expref: 40 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.787857:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd8 expref: 39 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390445.788672:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:2405:x1875263088527872:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 1969us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.788682:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 55 00010000:00010000:2.0:1788390445.789041:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390445.789044:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390445.789047:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5000, rc 0) 00000100:00100000:2.0:1788390445.789116:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:11210:x1875263088527744:12345-192.168.202.11@tcp:101:dd.0 Request processed in 7959us (10068us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788390445.789138:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:1.0:1788390445.793524:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390445.794076:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088528000 00000100:00100000:0.0:1788390445.794087:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088528000 00000100:00100000:0.0:1788390445.794200:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:0.0:1788390445.794212:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:11210:x1875263088528000:12345-192.168.202.11@tcp:101:dd.0 00010000:00010000:0.0:1788390445.794239:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390445.794263:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97a60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ddf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.794302:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.794317:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.794370:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.794495:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97a60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ddf expref: 40 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.794517:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ddf expref: 39 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390445.794533:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390445.794536:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390445.794540:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80e00, rc 0) 00000100:00100000:0.0:1788390445.794595:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:11210:x1875263088528000:12345-192.168.202.11@tcp:101:dd.0 Request processed in 385us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390445.794603:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:0.0:1788390445.797714:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390445.797901:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088528256 00000100:00100000:2.0:1788390445.797911:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088528256 00000100:00100000:2.0:1788390445.797976:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 61 00000100:00100000:2.0:1788390445.797987:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:11210:x1875263088528256:12345-192.168.202.11@tcp:36:dd.0 00010000:00010000:2.0:1788390445.798218:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.798231:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.798239:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390445.798266:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788390445.798279:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000282c5177 reply state 00000000e9366154 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.798288:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390445.798293:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390445.798295:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390445.798298:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390445.798604:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+42:11210:x1875263088528256:12345-192.168.202.11@tcp:36:dd.0 Request processed in 618us (899us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788390445.798611:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 61 00000020:00080000:3.0:1788390445.798616:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788390446.017553:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.017711:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088528384 00000100:00100000:2.0:1788390446.017724:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088528384 00000100:00100000:2.0:1788390446.017794:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 62 00000100:00100000:2.0:1788390446.017807:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+42:11224:x1875263088528384:12345-192.168.202.11@tcp:101:stat.0 00010000:00010000:2.0:1788390446.017855:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390446.017896:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97a75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243de6 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.017992:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018009:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018025:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018039:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018133:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018142:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018226:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018238:0:8996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd8 expref: 43 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018246:0:8996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018283:0:8996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd8 expref: 43 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.018309:0:8996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd8 expref: 43 pid: 8996 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390446.018410:0:8996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098034816:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390446.018559:0:8996:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87ee8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390446.024205:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390446.024295:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088528640 00000100:00100000:3.0:1788390446.024304:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088528640 00000100:00100000:3.0:1788390446.024427:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:3.0:1788390446.024439:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+44:6165:x1875263088528640:12345-192.168.202.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788390446.024751:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+45:6165:x1875263088528640:12345-192.168.202.11@tcp:35:ldlm_bl.0 Request processed in 314us (556us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788390446.024759:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:2.0:1788390446.025413:0:8996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098034816:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390446.025438:0:8996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390446.026752:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390446.026849:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088528768 00000100:00100000:1.0:1788390446.026858:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088528768 00010000:00010000:1.0:1788390446.026895:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd8 expref: 45 pid: 8996 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390446.026932:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 56 00000100:00100000:1.0:1788390446.026942:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+45:2404:x1875263088528768:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390446.026959:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390446.026966:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd8 expref: 45 pid: 8996 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.026981:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd8 expref: 45 pid: 8996 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.027003:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be97a52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dd8 expref: 45 pid: 8996 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.027020:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:1.0:1788390446.027025:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.027035:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.027042:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.027099:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390446.027152:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+44:2404:x1875263088528768:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 211us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390446.027160:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 56 00010000:00010000:2.0:1788390446.027669:0:8996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.027679:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390446.027731:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788390446.027737:0:8996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390446.027778:0:8996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.027792:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.027802:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.027988:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028007:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028014:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390446.028018:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028026:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028036:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:2.0:1788390446.028039:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390446.028043:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028050:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97a7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028074:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028081:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028087:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028091:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390446.028095:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028112:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028122:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fba803900) 00010000:00010000:2.0:1788390446.028124:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390446.028127:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028133:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97a83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028166:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97a75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243de6 expref: 44 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028180:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243de6 expref: 43 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.028188:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390446.028190:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390446.028193:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:2.0:1788390446.028258:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:11224:x1875263088528384:12345-192.168.202.11@tcp:101:stat.0 Request processed in 10454us (10718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390446.028267:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 62 00000100:00100000:0.0:1788390446.077027:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390446.077470:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088529024 00000100:00100000:1.0:1788390446.077480:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088529024 00000100:00100000:1.0:1788390446.077547:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 63 00000100:00100000:1.0:1788390446.077567:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:11230:x1875263088529024:12345-192.168.202.11@tcp:36:truncate.0 00010000:00010000:1.0:1788390446.077622:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390446.077649:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97a8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243de6 expref: 43 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.077669:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:1.0:1788390446.077675:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390446.077837:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.077848:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.077855:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390446.077886:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1788390446.077900:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b8b3ef5 reply state 0000000019d42acf transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.077909:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.077925:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:1.0:1788390446.077927:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788390446.077929:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390446.078020:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+45:11230:x1875263088529024:12345-192.168.202.11@tcp:36:truncate.0 Request processed in 464us (1008us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788390446.078027:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 63 00000020:00080000:1.0:1788390446.078032:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00100000:2.0:1788390446.167160:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:2.0:1788390446.167171:0:8402:0:(genops.c:885:class_export_put()) final put ffff984e878f2800/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:0.0:1788390446.167263:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984e878f2800/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa for lustre-OST0000 00000020:00000080:0.0:1788390446.167355:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e878f4000 for lustre-OST0000 00000100:00100000:1.0:1788390446.202200:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390446.202261:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088529152 00000100:00100000:3.0:1788390446.202272:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088529152 00000100:00100000:3.0:1788390446.202434:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 64 00000100:00100000:3.0:1788390446.202446:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+45:11244:x1875263088529152:12345-192.168.202.11@tcp:101:stat.0 00010000:00010000:3.0:1788390446.202471:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390446.202492:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be97a98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ded expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202587:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202602:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202615:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202627:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202635:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202642:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202717:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202728:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202735:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390446.202778:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788390446.202784:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390446.202807:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202841:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202851:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202858:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202864:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202871:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63dc00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390446.202875:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202883:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202895:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:3.0:1788390446.202899:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390446.202903:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202909:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be97a9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202924:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202930:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202942:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202947:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63c400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390446.202950:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202956:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202964:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fba803900) 00010000:00010000:3.0:1788390446.202967:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390446.202970:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.202975:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be97aa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.203003:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be97a98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ded expref: 47 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.203015:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ded expref: 46 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.203022:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:3.0:1788390446.203024:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390446.203027:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfc00, rc 0) 00000100:00100000:3.0:1788390446.203107:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+46:11244:x1875263088529152:12345-192.168.202.11@tcp:101:stat.0 Request processed in 662us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390446.203122:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 64 00010000:00010000:0.0:1788390446.227228:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390446.295960:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.296021:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088529408 00000100:00100000:2.0:1788390446.296033:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088529408 00000100:00100000:2.0:1788390446.296173:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 65 00000100:00100000:2.0:1788390446.296196:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+46:11254:x1875263088529408:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390446.296217:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390446.296237:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243df4 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390446.296377:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788390446.296477:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97ab4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243df4 expref: 48 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.296491:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:2.0:1788390446.296494:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390446.296511:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243df4 expref: 48 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.296526:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4600, rc 0) 00000100:00100000:2.0:1788390446.296609:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+47:11254:x1875263088529408:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 414us (657us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788390446.296617:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 65 00000100:00100000:0.0:1788390446.300762:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390446.304399:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088529664 00000100:00100000:3.0:1788390446.304749:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088529664 00000100:00100000:3.0:1788390446.304827:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 14 00000100:00100000:3.0:1788390446.304839:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+47:11254:x1875263088529664:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390446.305206:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+48:11254:x1875263088529664:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 367us (4452us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788390446.305215:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 14 00000100:00100000:0.0:1788390446.382247:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.382345:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088529920 00000100:00100000:2.0:1788390446.382355:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088529920 00000100:00100000:2.0:1788390446.382521:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 66 00000100:00100000:2.0:1788390446.382532:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+48:11261:x1875263088529920:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390446.382556:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390446.382578:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97ac2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243dfb expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.382685:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.382709:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ded expref: 49 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.382730:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.382762:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ded expref: 49 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.382775:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ded expref: 49 pid: 6494 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390446.382788:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098034944:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390446.382895:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87ee8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390446.386965:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390446.387085:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088530048 00000100:00100000:0.0:1788390446.387094:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088530048 00010000:00010000:0.0:1788390446.387133:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ded expref: 50 pid: 6494 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390446.387176:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 57 00000100:00100000:0.0:1788390446.387185:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+50:2405:x1875263088530048:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390446.387199:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390446.387206:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ded expref: 50 pid: 6494 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.387239:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ded expref: 50 pid: 6494 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.387262:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390446.387267:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.387277:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.387284:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.387302:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390446.387394:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+50:2405:x1875263088530048:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 210us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390446.387402:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 57 00010000:00010000:2.0:1788390446.387535:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be97aad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ded expref: 49 pid: 6494 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390446.387552:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098034944:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390446.387571:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.387580:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.387585:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390446.387602:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788390446.387745:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97ac2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dfb expref: 50 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.387760:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dfb expref: 49 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.387767:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390446.387770:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390446.387772:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5400, rc 0) 00000100:00100000:2.0:1788390446.387851:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+49:11261:x1875263088529920:12345-192.168.202.11@tcp:101:bash.0 Request processed in 5321us (5614us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788390446.387859:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 66 00000100:00100000:1.0:1788390446.397213:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390446.397498:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088530304 00000100:00100000:3.0:1788390446.397509:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088530304 00000100:00100000:3.0:1788390446.397605:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00100000:3.0:1788390446.397615:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+49:11261:x1875263088530304:12345-192.168.202.11@tcp:36:bash.0 00010000:00010000:3.0:1788390446.397870:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.397887:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.397898:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390446.397943:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788390446.397964:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4824d33 reply state 000000009a9f0394 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.397990:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.398014:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:3.0:1788390446.398017:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390446.398021:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390446.398121:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+52:11261:x1875263088530304:12345-192.168.202.11@tcp:36:bash.0 Request processed in 507us (919us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788390446.398129:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 67 00000020:00080000:3.0:1788390446.398134:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788390446.404156:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.404291:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088530432 00000100:00100000:2.0:1788390446.404301:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088530432 00000100:00100000:2.0:1788390446.404489:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:2.0:1788390446.404501:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+52:11261:x1875263088530432:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390446.404528:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390446.404549:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97ade lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e02 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.404644:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.404660:0:8996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dfb expref: 53 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.404669:0:8996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.404731:0:8996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dfb expref: 53 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.404745:0:8996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dfb expref: 53 pid: 12122 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390446.404758:0:8996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098035072:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390446.404857:0:8996:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87ee8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788390446.407790:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.407905:0:8996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098035072:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390446.407931:0:8996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390446.408062:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088530560 00000100:00100000:3.0:1788390446.408070:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088530560 00010000:00010000:3.0:1788390446.408515:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dfb expref: 54 pid: 12122 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390446.408545:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 58 00000100:00100000:3.0:1788390446.408555:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:2405:x1875263088530560:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390446.408570:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390446.408576:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dfb expref: 54 pid: 12122 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.408590:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dfb expref: 54 pid: 12122 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.408612:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97ac9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dfb expref: 54 pid: 12122 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.408629:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:3.0:1788390446.408634:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.408663:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.408671:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.409410:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390446.409469:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+53:2405:x1875263088530560:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 914us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390446.409478:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 58 00010000:00010000:2.0:1788390446.410611:0:8996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.410624:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390446.410680:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788390446.410685:0:8996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390446.410705:0:8996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.410810:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97ade lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e02 expref: 53 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.410829:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e02 expref: 52 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.410936:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390446.410938:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390446.410942:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4800, rc 0) 00000100:00100000:2.0:1788390446.411036:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+52:11261:x1875263088530432:12345-192.168.202.11@tcp:101:bash.0 Request processed in 6537us (7068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390446.411045:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:0.0:1788390446.415707:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.416177:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088530816 00000100:00100000:2.0:1788390446.416188:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088530816 00000100:00100000:2.0:1788390446.416251:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:2.0:1788390446.416262:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+52:11261:x1875263088530816:12345-192.168.202.11@tcp:35:bash.0 00000100:00100000:2.0:1788390446.416842:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+53:11261:x1875263088530816:12345-192.168.202.11@tcp:35:bash.0 Request processed in 571us (1134us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788390446.416852:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:1.0:1788390446.490485:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.490646:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088531072 00000100:00100000:2.0:1788390446.490657:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088531072 00000100:00100000:2.0:1788390446.490717:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 69 00000100:00100000:2.0:1788390446.490729:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+53:11271:x1875263088531072:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390446.490754:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390446.490775:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97aec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e09 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390446.490875:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788390446.490972:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97aec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e09 expref: 55 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.491005:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:2.0:1788390446.491008:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390446.491014:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97aec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e09 expref: 55 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.491027:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4600, rc 0) 00000100:00100000:2.0:1788390446.491097:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:11271:x1875263088531072:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 371us (622us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788390446.491105:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 69 00000100:00100000:0.0:1788390446.494902:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390446.495003:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088531200 00000100:00100000:3.0:1788390446.495017:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088531200 00000100:00100000:3.0:1788390446.495104:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 70 00000100:00100000:3.0:1788390446.495118:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:11271:x1875263088531200:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:3.0:1788390446.495224:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495244:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495261:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495275:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495283:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495289:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495461:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495472:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495482:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390446.495606:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495625:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495633:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495641:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495648:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cea00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390446.495653:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495663:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495680:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:3.0:1788390446.495684:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390446.495690:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495704:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97afa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495721:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495727:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495733:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495737:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cf200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390446.495740:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495745:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495752:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fba803900) 00010000:00010000:3.0:1788390446.495753:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390446.495756:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495760:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be97b01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495767:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495770:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495778:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495782:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cec00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390446.495784:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495787:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495791:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:3.0:1788390446.495792:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390446.495794:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390446.495797:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97b08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390446.495876:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:11271:x1875263088531200:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 760us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390446.495885:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 70 00000100:00100000:0.0:1788390446.498377:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390446.498477:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088531456 00000100:00100000:3.0:1788390446.498490:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088531456 00000100:00100000:3.0:1788390446.498569:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:3.0:1788390446.498582:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:11271:x1875263088531456:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390446.498890:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+55:11271:x1875263088531456:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 309us (567us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788390446.498899:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:1.0:1788390446.545752:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.545923:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088531712 00000100:00100000:2.0:1788390446.545933:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088531712 00000100:00100000:2.0:1788390446.546032:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 71 00000100:00100000:2.0:1788390446.546043:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+55:11274:x1875263088531712:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390446.546079:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390446.546114:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97b0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e10 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546196:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546211:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546223:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546237:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546260:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546267:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546467:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546477:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546486:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390446.546495:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788390446.546581:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546589:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546595:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546601:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390446.546605:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546612:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546635:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:2.0:1788390446.546638:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390446.546643:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546649:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97b16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546664:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546671:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546676:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546681:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390446.546684:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546690:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546697:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fba803900) 00010000:00010000:2.0:1788390446.546699:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390446.546702:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546707:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97b1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546761:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97b0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e10 expref: 58 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546776:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e10 expref: 57 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.546783:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390446.546785:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390446.546788:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:2.0:1788390446.546866:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+57:11274:x1875263088531712:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 825us (1129us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788390446.546873:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 71 00000100:00100000:0.0:1788390446.552657:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390446.555432:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390446.555707:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088531968 00000100:00100000:1.0:1788390446.555726:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088531968 00000100:00100000:1.0:1788390446.555824:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:1.0:1788390446.555837:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+57:2405:x1875263088531968:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390446.555856:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390446.555884:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e10 expref: 57 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390446.555911:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:1.0:1788390446.555917:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390446.555999:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+56:2405:x1875263088531968:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 163us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390446.556007:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:2.0:1788390446.556093:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088531840 00000100:00100000:2.0:1788390446.556098:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088531840 00000100:00100000:2.0:1788390446.556147:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 72 00000100:00100000:2.0:1788390446.556159:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+56:11274:x1875263088531840:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:2.0:1788390446.556227:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.556242:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.556252:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.556285:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.556311:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.556316:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.557702:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390446.557717:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.557726:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.557738:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390446.557741:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390446.557745:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.557751:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390446.557841:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+56:11274:x1875263088531840:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 1682us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390446.557857:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 72 00000100:00100000:0.0:1788390446.559882:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390446.560175:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088532224 00000100:00100000:3.0:1788390446.560189:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088532224 00000100:00100000:3.0:1788390446.560266:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:3.0:1788390446.560279:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+56:11274:x1875263088532224:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390446.560781:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+57:11274:x1875263088532224:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 495us (901us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788390446.560790:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:3.0:1788390446.703505:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390446.703697:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088532480 00000100:00100000:0.0:1788390446.703712:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088532480 00000100:00100000:0.0:1788390446.703848:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 73 00000100:00100000:0.0:1788390446.703880:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+57:11292:x1875263088532480:12345-192.168.202.11@tcp:101:cat.0 00010000:00010000:0.0:1788390446.703921:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390446.703947:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e17 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.704100:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b40 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.704117:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.704132:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390446.704145:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788390446.704288:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e17 expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.704314:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e17 expref: 59 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.704395:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390446.704399:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788390446.704403:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80a00, rc 0) 00000100:00100000:0.0:1788390446.704479:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11292:x1875263088532480:12345-192.168.202.11@tcp:101:cat.0 Request processed in 602us (989us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788390446.704487:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 73 00000100:00100000:1.0:1788390446.727030:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.728983:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088532608 00000100:00100000:2.0:1788390446.728995:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088532608 00000100:00100000:2.0:1788390446.729090:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 74 00000100:00100000:2.0:1788390446.729104:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11293:x1875263088532608:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390446.729132:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390446.729180:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e1e expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.729247:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97b55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.729258:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.729266:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390446.729317:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788390446.729337:0:8996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390446.729353:0:8996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.729373:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e1e expref: 61 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.729387:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97b55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e1e expref: 60 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.729392:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:2.0:1788390446.729394:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390446.729398:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4600, rc 0) 00000100:00100000:2.0:1788390446.729458:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11293:x1875263088532608:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 357us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390446.729465:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 74 00000100:00100000:3.0:1788390446.734594:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390446.734714:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088532992 00000100:00100000:0.0:1788390446.734764:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088532992 00000100:00100000:0.0:1788390446.734830:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:0.0:1788390446.734838:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11293:x1875263088532992:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:0.0:1788390446.736128:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11293:x1875263088532992:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 1282us (1537us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788390446.736140:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:3.0:1788390446.738035:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390446.738120:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088533120 00000100:00100000:0.0:1788390446.738129:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088533120 00000100:00100000:0.0:1788390446.738181:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:0.0:1788390446.738190:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7871880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11293:x1875263088533120:12345-192.168.202.11@tcp:103:lfs.0 00010000:00010000:0.0:1788390446.738207:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788390446.738231:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97ae5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e02 expref: 61 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.738254:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e17 expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.738268:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be979e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243dbc expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.738275:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390446.738279:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390446.738347:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7871880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:11293:x1875263088533120:12345-192.168.202.11@tcp:103:lfs.0 Request processed in 158us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390446.738354:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:1.0:1788390446.740216:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390446.740486:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088533248 00000100:00100000:2.0:1788390446.740571:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088533248 00000100:00100000:2.0:1788390446.740660:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 75 00000100:00100000:2.0:1788390446.740671:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:11293:x1875263088533248:12345-192.168.202.11@tcp:58:lfs.0 00010000:00010000:2.0:1788390446.740799:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.740829:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390446.740842:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390446.741173:0:12122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390446.741428:0:12122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788390446.741555:0:12122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788390446.741643:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:11293:x1875263088533248:12345-192.168.202.11@tcp:58:lfs.0 Request processed in 972us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390446.741651:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 75 00000100:00100000:3.0:1788390446.755961:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390446.756095:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088533376 00000100:00100000:0.0:1788390446.756109:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088533376 00000100:00100000:0.0:1788390446.756234:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 76 00000100:00100000:0.0:1788390446.756259:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:11295:x1875263088533376:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390446.756279:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390446.756298:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97b63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e25 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756402:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756417:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756428:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756502:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756512:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756519:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756611:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756621:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756627:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390446.756676:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788390446.756680:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390446.756696:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756709:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756718:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756724:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756731:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756736:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390446.756741:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756747:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756759:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390446.756762:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390446.756766:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756772:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97b6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756797:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756803:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756807:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756825:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390446.756827:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756833:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756840:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fba803900) 00010000:00010000:0.0:1788390446.756843:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390446.756846:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756851:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97b71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756878:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97b63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e25 expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756890:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e25 expref: 59 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390446.756908:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390446.756910:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390446.756913:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81400, rc 0) 00000100:00100000:0.0:1788390446.756991:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11295:x1875263088533376:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 733us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390446.756998:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 76 00010000:00010000:0.0:1788390447.251193:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390447.311294:0:14174:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390447.311303:0:14174:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390447.311344:0:14174:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788390447.311352:0:14174:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788390447.446770:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390447.446778:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390447.446813:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788390447.446818:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788390447.446934:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb153480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098035200:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390447.447001:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86833300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390447.456181:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb153480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098035200:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788390447.458488:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390447.460530:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088533504 00000100:00100000:3.0:1788390447.460605:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088533504 00000100:00100000:3.0:1788390447.460747:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 77 00000100:00100000:3.0:1788390447.460759:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11307:x1875263088533504:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390447.460790:0:6492:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390447.460906:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11307:x1875263088533504:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 149us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390447.460915:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 77 00000100:00080000:0.0:1788390447.463683:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390447.472604:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390447.472688:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088533632 00000100:00100000:2.0:1788390447.472699:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088533632 00000100:00100000:2.0:1788390447.472766:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 78 00000100:00100000:2.0:1788390447.472777:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11307:x1875263088533632:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788390447.472866:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.472884:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.472898:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.472930:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.472937:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.472945:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.472971:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.472981:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.472988:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390447.473034:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788390447.473038:0:12122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390447.473064:0:12122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473075:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473086:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473092:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473097:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390447.473101:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473107:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473119:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:2.0:1788390447.473122:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390447.473126:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473131:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97b7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473143:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473148:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473153:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473157:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390447.473164:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473169:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473175:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff984f8c933d00) 00010000:00010000:2.0:1788390447.473177:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390447.473179:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473184:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97b86 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473197:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473203:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473208:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473212:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390447.473214:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473219:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473225:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390447.473227:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390447.473234:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.473239:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97b8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390447.473358:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11307:x1875263088533632:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 Request processed in 545us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390447.473366:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 78 00000100:00100000:3.0:1788390447.481802:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390447.481881:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088533888 00000100:00100000:0.0:1788390447.481892:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088533888 00000100:00100000:0.0:1788390447.481949:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 79 00000100:00100000:0.0:1788390447.481956:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11307:x1875263088533888:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390447.481975:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390447.481994:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97b94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e2c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482115:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482131:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482144:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390447.482156:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788390447.482231:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482253:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482259:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482265:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.482269:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482277:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482290:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390447.482293:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390447.482298:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482302:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97b9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482373:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97b94 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e2c expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482383:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:0.0:1788390447.482385:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390447.482389:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97b94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e2c expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.482398:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80400, rc 0) 00000100:00100000:0.0:1788390447.482470:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11307:x1875263088533888:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 512us (679us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1788390447.482478:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 79 00000100:00100000:3.0:1788390447.487765:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.488494:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088534016 00000100:00100000:1.0:1788390447.488506:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088534016 00000100:00100000:1.0:1788390447.488576:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 80 00000100:00100000:1.0:1788390447.488588:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11307:x1875263088534016:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788390447.488625:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788390447.488763:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11307:x1875263088534016:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 177us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.488770:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 80 00000100:00100000:2.0:1788390447.493114:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.493219:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088534272 00000100:00100000:1.0:1788390447.493229:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088534272 00000100:00100000:1.0:1788390447.493294:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 81 00000100:00100000:1.0:1788390447.493304:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11307:x1875263088534272:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390447.493355:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390447.493358:0:8996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788390447.493386:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97b55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e1e expref: 60 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.493407:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:1.0:1788390447.493412:0:8996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390447.493425:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be97ba9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e33 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788390447.493778:0:8996:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788390447.493897:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.493907:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.493914:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.493948:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be97ba9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e33 expref: 62 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.493958:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e33 expref: 61 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.493963:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984fba803000) 00010000:00010000:1.0:1788390447.493965:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390447.493967:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cea00, rc 0) 00000100:00100000:1.0:1788390447.494015:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11307:x1875263088534272:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 713us (910us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788390447.494022:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 81 00000100:00100000:3.0:1788390447.498437:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.498966:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088534528 00000100:00100000:1.0:1788390447.498975:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088534528 00000100:00100000:1.0:1788390447.499031:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 82 00000100:00100000:1.0:1788390447.499051:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11307:x1875263088534528:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390447.499132:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390447.499161:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e33 expref: 61 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499177:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984fba803000) 00010000:00010000:1.0:1788390447.499186:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390447.499205:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499216:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499225:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499284:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499290:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499295:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499359:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499367:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499374:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499380:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390447.499390:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499397:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499406:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:1.0:1788390447.499409:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390447.499412:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499418:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be97bbe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499427:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499434:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499439:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499443:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cf400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390447.499445:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499448:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499453:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb6f79111 (ffff984fba803a00) 00010000:00010000:1.0:1788390447.499455:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390447.499461:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.499464:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97bc5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb6f79111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.499546:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11307:x1875263088534528:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 506us (1117us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390447.499554:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 82 00000100:00100000:3.0:1788390447.501962:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390447.502160:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088534656 00000100:00100000:2.0:1788390447.502172:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088534656 00000100:00100000:2.0:1788390447.502247:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 83 00000100:00100000:2.0:1788390447.502257:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11307:x1875263088534656:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390447.502280:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390447.502304:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97bcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e3a expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.502385:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.502400:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.502412:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.502533:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97bcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e3a expref: 62 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.502574:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e3a expref: 61 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.502582:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:2.0:1788390447.502586:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390447.502589:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:2.0:1788390447.502654:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11307:x1875263088534656:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 398us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390447.502661:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 83 00000100:00100000:3.0:1788390447.505568:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390447.506700:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088534912 00000100:00100000:0.0:1788390447.506713:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088534912 00000100:00100000:0.0:1788390447.506783:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 84 00000100:00100000:0.0:1788390447.506795:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11307:x1875263088534912:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788390447.506877:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.506895:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.506906:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390447.507144:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788390447.507155:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 268064832744ns, next at 269064829810ns, rc = 0 00000004:00010000:0.0:1788390447.507270:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0aa2563 reply state 00000000fb21f266 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.507283:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.507291:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:0.0:1788390447.507294:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788390447.507297:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390447.507830:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:11307:x1875263088534912:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 1034us (2271us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788390447.507838:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 84 00000100:00100000:3.0:1788390447.512032:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390447.512167:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088535040 00000100:00100000:2.0:1788390447.512178:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088535040 00000100:00100000:2.0:1788390447.512234:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 85 00000100:00100000:2.0:1788390447.512244:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:11307:x1875263088535040:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390447.512266:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390447.512286:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e41 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.512374:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e41 expref: 64 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.512390:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e41 expref: 64 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.512409:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:2.0:1788390447.512413:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390447.512428:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4800, rc 0) 00000100:00100000:2.0:1788390447.512496:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+64:11307:x1875263088535040:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 253us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390447.512503:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 85 00000100:00100000:3.0:1788390447.515457:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390447.515994:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088535168 00000100:00100000:2.0:1788390447.516007:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088535168 00000100:00100000:2.0:1788390447.516054:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 32 00000100:00100000:2.0:1788390447.516063:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1875263088535168:12345-192.168.202.11@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788390447.516100:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1788390447.516139:0:8409:0:(genops.c:1385:class_connect()) connect: client 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa, cookie 0xe156d0713be97be8 00002000:00100000:2.0:1788390447.516152:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa/ffff984f90ebb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788390447.516172:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788390447.516257:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788390447.516287:0:8409:0:(import.c:65:import_set_state_nolock()) ffff984f90eba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390447.516618:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2403:x1875263088535168:12345-192.168.202.11@tcp:8:lhsmtool_posix.0 Request processed in 553us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390447.516625:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 32 00000100:00100000:3.0:1788390447.522036:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390447.522444:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088535296 00000100:00100000:2.0:1788390447.522456:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088535296 00000100:00100000:2.0:1788390447.522705:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:2.0:1788390447.522713:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:0:x1875263088535296:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788390447.524868:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788390447.525480:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1788390447.525491:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000100:00100000:3.0:1788390447.525699:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:0:x1875263088535296:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 2980us (3667us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788390447.525823:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:1.0:1788390447.527952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390447.528079:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088535552 00000100:00100000:2.0:1788390447.528090:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088535552 00000100:00100000:2.0:1788390447.528139:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:2.0:1788390447.528146:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+64:11307:x1875263088535552:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788390447.528423:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:11307:x1875263088535552:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 275us (475us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788390447.528431:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:1.0:1788390447.532724:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390447.533106:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088535808 00000100:00100000:2.0:1788390447.533117:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088535808 00000100:00100000:2.0:1788390447.533195:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 86 00000100:00100000:2.0:1788390447.533251:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:11307:x1875263088535808:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788390447.533652:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:11307:x1875263088535808:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 403us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390447.533658:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 86 00000100:00100000:3.0:1788390447.536992:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390447.537133:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088535936 00000100:00100000:0.0:1788390447.537145:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088535936 00000100:00100000:0.0:1788390447.537214:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 87 00000100:00100000:0.0:1788390447.537225:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:11307:x1875263088535936:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390447.537244:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390447.537264:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97bef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e48 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.537823:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.537836:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.537845:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390447.537891:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390447.537912:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.537944:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97bef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e48 expref: 67 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.537964:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e48 expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.537993:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:1.0:1788390447.537996:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788390447.538000:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cea00, rc 0) 00000100:00100000:1.0:1788390447.538077:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:11307:x1875263088535936:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 853us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.538085:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 87 00000100:00100000:3.0:1788390447.541100:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390447.541218:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088536064 00000100:00100000:0.0:1788390447.541228:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088536064 00000100:00100000:0.0:1788390447.541293:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 34 00000100:00100000:0.0:1788390447.541303:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088536064:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390447.541356:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390447.541383:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e4f expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390447.541420:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac2f, blocks: 0x0 00010000:00010000:0.0:1788390447.541439:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1788390447.541444:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390447.541452:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e4f expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.541481:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e4f expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.541495:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80a00, rc 0) 00000100:00100000:0.0:1788390447.543070:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088536064:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 1538us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390447.543080:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 34 00000100:00100000:3.0:1788390447.547715:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.555345:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088536320 00000100:00100000:1.0:1788390447.555361:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088536320 00000100:00100000:1.0:1788390447.555638:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 88 00000100:00100000:1.0:1788390447.555649:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:11307:x1875263088536320:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788390447.555775:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:11307:x1875263088536320:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 127us (8071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.555782:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 88 00000100:00100000:2.0:1788390447.559280:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390447.559557:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088536448 00000100:00100000:3.0:1788390447.559568:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088536448 00000100:00100000:3.0:1788390447.559719:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:3.0:1788390447.559731:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:11307:x1875263088536448:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390447.559749:0:8798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390447.559769:0:8798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e56 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.559800:0:8798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e4f expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.559809:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390447.559814:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390447.559820:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 7 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.559874:0:8798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e4f expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.559890:0:8798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e4f expref: 7 pid: 8407 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390447.559919:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098035328:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390447.560006:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1e2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390447.562291:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.562408:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088536576 00000100:00100000:1.0:1788390447.562417:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088536576 00010000:00010000:1.0:1788390447.562456:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e4f expref: 8 pid: 8407 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.562504:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:1.0:1788390447.562514:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088536576:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390447.562527:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390447.562558:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e4f expref: 8 pid: 8407 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.562598:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e4f expref: 8 pid: 8407 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.562621:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390447.562625:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390447.562633:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 8 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.562642:0:10369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 8 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.562675:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 8 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.562689:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10369:1875263098035456:192.168.202.11@tcp:105: 00000100:00100000:1.0:1788390447.562757:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05600 going to sleep for 11 seconds 00010000:00010000:3.0:1788390447.563684:0:8798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be97bfd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e4f expref: 8 pid: 8407 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390447.563701:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098035328:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390447.563722:0:8798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 7 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.563733:0:8798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf200, rc 0) 00000100:00100000:3.0:1788390447.563813:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:11307:x1875263088536448:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 4084us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390447.563820:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:1.0:1788390447.569287:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10369:1875263098035456:192.168.202.11@tcp:105: 00010000:00010000:1.0:1788390447.569719:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390447.569783:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088536576:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 7268us (7500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.569795:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:0.0:1788390447.573849:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.573983:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088536704 00000100:00100000:1.0:1788390447.573994:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088536704 00002000:00100000:1.0:1788390447.574055:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff984e877c8700 x1875263088536704/t0(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:63/0 lens 504/0 e 0 to 0 dl 1788390458 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390447.574080:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e877c8700 with x1875263088536704 ext(0->8) 00002000:00010000:1.0:1788390447.574086:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e877c8700 00000100:00100000:1.0:1788390447.574127:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:1.0:1788390447.574138:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088536704:12345-192.168.202.11@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788390447.581001:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088536704:12345-192.168.202.11@tcp:4:lhsmtool_posix.0 Request processed in 6851us (7151us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788390447.581021:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 0 00002000:00100000:0.0:1788390447.581034:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff984e877c8700 x1875263088536704/t4294967303(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:63/0 lens 504/448 e 0 to 0 dl 1788390458 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390447.581055:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e877c8700 with x1875263088536704 ext(0->8) 00002000:00010000:0.0:1788390447.581062:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e877c8700 00000100:00100000:2.0:1788390447.588731:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.588845:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088536832 00000100:00100000:1.0:1788390447.588855:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088536832 00000100:00100000:1.0:1788390447.588923:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 89 00000100:00100000:1.0:1788390447.588934:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:11307:x1875263088536832:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788390447.597431:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1788390447.597446:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1788390447.597511:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788390447.597629:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597642:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597651:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597657:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.597661:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597669:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597684:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff984f8c933900) 00010000:00010000:0.0:1788390447.597700:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390447.597706:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597713:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9791e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597736:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597742:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597748:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597752:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63da00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.597755:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597760:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597768:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390447.597770:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390447.597772:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597778:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be97925 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597794:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597809:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597815:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597819:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.597822:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597828:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597836:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fba803900) 00010000:00010000:0.0:1788390447.597838:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390447.597841:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597846:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be97964 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597863:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597868:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597874:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597879:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.597887:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597893:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597901:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390447.597903:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390447.597906:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597911:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97a6e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597922:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597928:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597933:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597937:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cf600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.597939:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597945:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597952:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390447.597955:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390447.597963:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597969:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97a91 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597981:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597987:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597992:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.597997:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cf000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.598000:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598006:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598013:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390447.598028:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390447.598031:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598037:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be97ad7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598059:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598065:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598076:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598081:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.598084:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598090:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598098:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:0.0:1788390447.598100:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788390447.598103:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.598108:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97bda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.598414:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390447.598432:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098035584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788390447.598500:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788390447.598800:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984f888923c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788390447.598806:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984fb78f2000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984f88892f00 00000020:00080000:2.0:1788390447.598809:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984fb78f2700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984f88a01200 00000100:00100000:2.0:1788390447.598865:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098035584 00000100:00100000:2.0:1788390447.598872:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098035584 00000100:00100000:2.0:1788390447.598931:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788390447.598940:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098035584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788390447.599074:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788390447.599078:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788390447 00002000:00010000:2.0:1788390447.599081:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788390447.599089:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788390447 -> 1788390447 00002000:00010000:2.0:1788390447.599092:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788390447.599136:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098035584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (635us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788390447.599145:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788390447.599257:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:11307:x1875263088536832:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 Request processed in 10323us (10533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390447.599265:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 89 00000020:00080000:3.0:1788390447.599499:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788390447.599665:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788390447.599800:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390447.599813:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098035712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788390447.599850:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390447.599880:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098035712 00000100:00100000:0.0:1788390447.599884:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098035712 00000100:00100000:0.0:1788390447.599912:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390447.599920:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263098035712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788390447.599937:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788390447.599961:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a98ac2d, atime: 0x6a98ac2d, ctime: 0x6a98ac2d, blocks: 0x8 00010000:00010000:0.0:1788390447.599969:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.599991:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1788390447.599996:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390447.600002:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.600018:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.600026:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.600034:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.600063:0:8407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788390447.600163:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3622:x1875263098035712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 243us (312us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788390447.600169:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788390447.600190:0:13156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390447.600196:0:13156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.600204:0:13156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390447.600208:0:13156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.600226:0:13156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.600243:0:13156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.600249:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be97c0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.600263:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390447.600265:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390447.600267:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788390447.600294:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984f89f33480/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788390447.600300:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098035712:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788390447.600451:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390447.600455:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788390447.601172:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984f85ae3b80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788390447.601180:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098035584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788390447.603149:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390447.603243:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088536960 00000100:00100000:2.0:1788390447.603252:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088536960 00000100:00100000:2.0:1788390447.603310:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 38 00000100:00100000:2.0:1788390447.603356:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088536960:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788390447.605184:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788390447.605196:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788390447.605392:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088536960:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 Request processed in 2069us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390447.605403:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 38 00000100:00100000:0.0:1788390447.609028:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.609232:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088537216 00000100:00100000:1.0:1788390447.609244:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088537216 00000100:00100000:1.0:1788390447.609449:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 90 00000100:00100000:1.0:1788390447.609460:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:11307:x1875263088537216:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390447.609524:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390447.609562:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97bf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e48 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.609590:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:1.0:1788390447.609607:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390447.609639:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.609654:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.609665:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390447.609786:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc51a095 reply state 00000000477038d3 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.609798:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.609804:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:1.0:1788390447.609807:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788390447.609810:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390447.609915:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:11307:x1875263088537216:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 456us (906us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788390447.609924:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 90 00000100:00100000:0.0:1788390447.613557:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390447.613903:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088537344 00000100:00100000:3.0:1788390447.613915:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088537344 00000100:00100000:2.0:1788390447.614171:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:2.0:1788390447.614183:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088537344:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788390447.614698:0:8798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788390447.614704:0:8798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788390447 -> 1788390446 00002000:00010000:2.0:1788390447.614707:0:8798:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788390445 00002000:00010000:2.0:1788390447.614709:0:8798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788390447 -> 1788390446 00002000:00010000:2.0:1788390447.614712:0:8798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788390447.614786:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088537344:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 604us (1238us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788390447.614794:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:0.0:1788390447.618111:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390447.618210:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088537600 00000100:00100000:3.0:1788390447.618220:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088537600 00000100:00100000:3.0:1788390447.618283:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 91 00000100:00100000:3.0:1788390447.618306:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:11307:x1875263088537600:12345-192.168.202.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788390447.618413:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.618430:0:8996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e3a expref: 15 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.618439:0:8996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.618480:0:8996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e3a expref: 15 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.618494:0:8996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e3a expref: 15 pid: 12122 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390447.618508:0:8996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f32680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098035840:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390447.618589:0:8996:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1e2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390447.623652:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390447.623776:0:8996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f32680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098035840:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390447.623804:0:8996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.623948:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088537728 00000100:00100000:1.0:1788390447.623956:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088537728 00010000:00010000:1.0:1788390447.623995:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e3a expref: 16 pid: 12122 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.624086:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:1.0:1788390447.624096:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:2404:x1875263088537728:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390447.624113:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390447.624135:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e3a expref: 16 pid: 12122 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.624149:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e3a expref: 16 pid: 12122 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.624172:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97bd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e3a expref: 16 pid: 12122 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.624189:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:1.0:1788390447.624195:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.624217:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.624225:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.624257:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390447.624361:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:2404:x1875263088537728:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 266us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.624369:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 60 00010000:00010000:3.0:1788390447.624900:0:8996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.624910:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.624950:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.624966:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.624972:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.624978:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cec00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390447.624983:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.624991:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.625002:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:3.0:1788390447.625004:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788390447.625008:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.625025:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c19 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390447.625098:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:11307:x1875263088537600:12345-192.168.202.11@tcp:55:lhsmtool_posix.0 Request processed in 6792us (6997us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788390447.625107:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 91 00000100:00100000:0.0:1788390447.629668:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.629920:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088537856 00000100:00100000:1.0:1788390447.629931:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088537856 00000100:00100000:1.0:1788390447.630025:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00100000:1.0:1788390447.630047:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088537856:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788390447.630095:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.630134:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 7 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.630143:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390447.630148:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390447.630152:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.630187:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 7 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.630217:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 7 pid: 8798 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.630231:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1875263098035968:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390447.630353:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390447.635403:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390447.635493:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088537984 00000100:00100000:0.0:1788390447.635502:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088537984 00010000:00010000:0.0:1788390447.635550:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 8 pid: 8798 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390447.635617:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 61 00000100:00100000:0.0:1788390447.635627:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088537984:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390447.635641:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390447.635662:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 8 pid: 8798 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.635676:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 8 pid: 8798 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.635700:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390447.635704:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390447.635710:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.635719:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.635738:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390447.635793:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088537984:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 168us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390447.635801:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 61 00010000:00010000:1.0:1788390447.638158:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f20849c/0xe156d0713be97c04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e56 expref: 7 pid: 8798 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.638184:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1875263098035968:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390447.638522:0:8407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.638545:0:8407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.638568:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.638597:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.638606:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.638614:0:8407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.638621:0:8407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cea00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390447.638626:0:8407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.638635:0:8407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.638653:0:8407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.638661:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c6084cb/0xe156d0713be97c20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.638760:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088537856:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 Request processed in 8724us (9102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.638770:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00100000:2.0:1788390447.641943:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.642070:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088538240 00000100:00100000:1.0:1788390447.642081:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088538240 00000100:00100000:1.0:1788390447.642192:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 92 00000100:00100000:1.0:1788390447.642214:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:11307:x1875263088538240:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788390447.642297:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.642315:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ddf expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.642356:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.642398:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ddf expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.642411:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ddf expref: 14 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.642425:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098036096:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390447.642620:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390447.644302:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098036096:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390447.644623:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390447.645242:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390447.645693:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088538368 00000100:00100000:3.0:1788390447.645702:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088538368 00010000:00010000:3.0:1788390447.645739:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ddf expref: 15 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390447.645779:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 62 00000100:00100000:3.0:1788390447.645799:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:2404:x1875263088538368:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390447.645815:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390447.645822:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ddf expref: 15 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.645837:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ddf expref: 15 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.645861:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97a67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ddf expref: 15 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.645878:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:3.0:1788390447.645883:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.645893:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.645901:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390447.645918:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390447.646135:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:2404:x1875263088538368:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 336us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390447.646142:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 62 00010000:00010000:0.0:1788390447.646252:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.646262:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.646783:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.646797:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e41 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.646806:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.646839:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e41 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.646854:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e41 expref: 14 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390447.646868:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098036224:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390447.647135:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071540 going to sleep for 11 seconds 00000100:00100000:0.0:1788390447.649169:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.649306:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088538496 00000100:00100000:1.0:1788390447.649316:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088538496 00010000:00010000:1.0:1788390447.649521:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e41 expref: 15 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.649568:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 63 00000100:00100000:1.0:1788390447.649579:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:2405:x1875263088538496:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390447.649592:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390447.649599:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e41 expref: 15 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.649613:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e41 expref: 15 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.649633:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:1.0:1788390447.649638:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.649648:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.649655:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.649672:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390447.649728:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:2405:x1875263088538496:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 151us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.649748:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 63 00010000:00010000:2.0:1788390447.650688:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97be1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e41 expref: 14 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390447.650717:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098036224:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390447.650736:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.650745:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.650751:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390447.650854:0:12122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788390447.650969:0:12122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788390447.651004:0:12122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788390447.651259:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12122:1875263098036352:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788390447.651314:0:12122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390447.651434:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390447.651641:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098036352 00000100:00100000:1.0:1788390447.651647:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098036352 00000100:00100000:1.0:1788390447.651690:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788390447.651699:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12122:x1875263098036352:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788390447.651791:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12122:x1875263098036352:12345-0@lo:1000:mdt00_004.0 Request processed in 92us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.651799:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788390447.651881:0:12122:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788390447.651887:0:12122:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984f85ae3b80, transno 4294967304 00000100:00100000:0.0:1788390447.651904:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12122:1875263098036352:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788390447.652030:0:12122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788390447.652081:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12122:1875263098036480:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788390447.652111:0:12122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390447.652137:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098036480 00000100:00100000:0.0:1788390447.652141:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098036480 00000100:00100000:0.0:1788390447.652170:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788390447.652176:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12122:x1875263098036480:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788390447.652251:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12122:x1875263098036480:12345-0@lo:1000:mdt00_004.0 Request processed in 74us (139us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788390447.652257:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788390447.652275:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390447.652289:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12122:1875263098036480:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788390447.652313:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652348:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652355:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652464:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.652476:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652484:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652499:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:0.0:1788390447.652502:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390447.652506:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652512:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97c2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652602:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652609:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652615:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652620:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390447.652623:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652629:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652636:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390447.652638:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390447.652641:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652646:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97b5c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652687:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652699:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e25 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652708:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652735:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e25 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390447.652749:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e25 expref: 17 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390447.652761:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098036608:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390447.652811:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071300 going to sleep for 11 seconds 00000100:00100000:2.0:1788390447.654849:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098036608:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390447.654872:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390447.655108:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390447.655175:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088538624 00000100:00100000:1.0:1788390447.655183:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088538624 00010000:00010000:1.0:1788390447.655215:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e25 expref: 18 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390447.655253:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 64 00000100:00100000:1.0:1788390447.655263:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:2405:x1875263088538624:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390447.655276:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390447.655284:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e25 expref: 18 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.655295:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e25 expref: 18 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.655314:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97b78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e25 expref: 18 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.655357:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:1.0:1788390447.655484:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.655493:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.655500:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.655524:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390447.655712:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:2405:x1875263088538624:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 449us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.655720:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 64 00010000:00010000:2.0:1788390447.656033:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656051:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656063:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656081:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656088:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656094:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390447.656098:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656105:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656114:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390447.656117:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390447.656121:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656127:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97c35 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656139:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656145:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656151:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656155:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cf800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390447.656164:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656169:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656175:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:2.0:1788390447.656177:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390447.656180:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.656184:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c27 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390447.656352:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:11307:x1875263088538240:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 14150us (14419us total) trans 4294967362 rc 0/0 00000040:00080000:3.0:1788390447.656731:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788390447.656736:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390447.656752:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788390447.656759:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788390447.656847:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 92 00000020:00080000:2.0:1788390447.656852:0:12122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788390447.658899:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390447.659007:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088538880 00000100:00100000:2.0:1788390447.659027:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088538880 00000100:00100000:2.0:1788390447.659124:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 20 00000100:00100000:2.0:1788390447.659134:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:11307:x1875263088538880:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788390447.659449:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788390447.659497:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1788390447.659532:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.659559:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.659571:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.659594:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.659602:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.659608:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390447.659627:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788390447.659718:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:11307:x1875263088538880:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 586us (827us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788390447.659726:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 20 00000020:00080000:2.0:1788390447.659730:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390447.659850:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390447.659857:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.659864:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390447.659869:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.659877:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.659890:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:1.0:1788390447.659892:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788390447.659897:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.659903:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97c3c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390447.659927:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390447.659929:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390447.659931:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390447.698070:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098036736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390447.698149:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390447.698341:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098036736 00000100:00100000:0.0:1788390447.698351:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098036736 00000100:00100000:0.0:1788390447.698409:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788390447.698418:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098036736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390447.698439:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788390447.698479:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098036736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390447.698487:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788390447.698586:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098036864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788390447.698620:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390447.698943:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098036864 00000100:00100000:3.0:1788390447.698948:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098036864 00000100:00100000:3.0:1788390447.698994:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788390447.699002:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098036864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390447.699027:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788390447.699072:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098036864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390447.699078:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788390447.699121:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098036864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390447.699159:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098036736:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390447.699367:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390447.699914:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098036992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788390447.699963:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390447.700415:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098036992 00000100:00100000:1.0:1788390447.700422:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098036992 00000100:00100000:1.0:1788390447.700456:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788390447.700464:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098036992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788390447.700503:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788390447.700557:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098036992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390447.700564:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788390447.700908:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098036992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390448.209533:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390448.209556:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098037120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390448.209557:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098037248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390448.209694:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098037376:0@lo:400:kworker.0 00000100:00100000:0.0:1788390448.209748:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098037632:0@lo:400:kworker.0 00000100:00100000:3.0:1788390448.210140:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390448.210200:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098037504:0@lo:400:kworker.0 00000100:00100000:3.0:1788390448.210227:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390448.210246:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098038016:0@lo:400:kworker.0 00000100:00100000:3.0:1788390448.210266:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390448.210299:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098037120 00000100:00100000:3.0:1788390448.210306:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098037120 00000100:00100000:3.0:1788390448.210448:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788390448.210458:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875263098037120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390448.210567:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390448.210690:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875263098037120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390448.210711:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788390448.210775:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098037120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390448.210812:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098037504 00000100:00100000:3.0:1788390448.210815:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098037504 00000100:00100000:3.0:1788390448.210841:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098038016 00000100:00100000:3.0:1788390448.210844:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098038016 00000100:00100000:3.0:1788390448.211552:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788390448.211562:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098037504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390448.211622:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098037504:12345-0@lo:400:kworker.0 Request processed in 62us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390448.211629:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788390448.211644:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788390448.211651:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098038016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390448.211681:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098038016:12345-0@lo:400:kworker.0 Request processed in 31us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390448.211687:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788390448.211718:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098037504:0@lo:400:kworker.0 00010000:00080000:3.0:1788390448.211732:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb16e300 x1875263098038016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390448.211742:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098038016:0@lo:400:kworker.0 00000100:00080000:3.0:1788390448.211783:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788390448.212199:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390448.212257:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098037760:0@lo:400:kworker.0 00000100:00100000:2.0:1788390448.212288:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390448.212305:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098038272:0@lo:400:kworker.0 00000100:00100000:2.0:1788390448.212341:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390448.212523:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788390448.212530:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098037888:0@lo:400:kworker.0 00000100:00100000:2.0:1788390448.212604:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390448.212627:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098038400:0@lo:400:kworker.0 00000100:00100000:2.0:1788390448.212649:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390448.212683:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098037248 00000100:00100000:3.0:1788390448.212691:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098037248 00000100:00100000:2.0:1788390448.212693:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098038400 00000100:00100000:2.0:1788390448.212704:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098038400 00000100:00100000:3.0:1788390448.212738:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788390448.212743:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788390448.212752:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1875263098037248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788390448.212778:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390448.212821:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1875263098037248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390448.212827:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788390448.212845:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390448.213007:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098038400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390448.213016:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098037760 00000100:00100000:3.0:1788390448.213023:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098037760 00000100:00100000:3.0:1788390448.213058:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098038272 00000100:00100000:3.0:1788390448.213061:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098038272 00000100:00100000:3.0:1788390448.213081:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098037888 00000100:00100000:3.0:1788390448.213083:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098037888 00000100:00100000:3.0:1788390448.213097:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788390448.213103:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098037760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390448.213703:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390448.213768:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788390448.213790:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098038272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390448.213827:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098038272:12345-0@lo:400:kworker.0 Request processed in 42us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390448.213834:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788390448.213848:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788390448.213854:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098037888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390448.213875:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098037888:12345-0@lo:400:kworker.0 Request processed in 21us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390448.213881:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:1.0:1788390448.213895:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390448.213898:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390448.213925:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098037376 00000100:00100000:1.0:1788390448.213929:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098037376 00000100:00100000:1.0:1788390448.213956:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788390448.213962:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098037376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390448.213990:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098037376:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390448.213996:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788390448.214045:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098037376:0@lo:400:kworker.0 00000100:00100000:0.0:1788390448.214771:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390448.214798:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098037760:12345-0@lo:400:kworker.0 Request processed in 1692us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390448.214807:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788390448.214837:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098038400:12345-0@lo:400:kworker.0 Request processed in 2086us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390448.214847:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788390448.214931:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098038144:0@lo:400:kworker.0 00000100:00100000:0.0:1788390448.214963:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390448.215006:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098038144 00000100:00100000:2.0:1788390448.215011:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098038144 00000100:00100000:3.0:1788390448.215021:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098037888:0@lo:400:kworker.0 00000100:00100000:3.0:1788390448.215054:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098038400:0@lo:400:kworker.0 00000100:00100000:3.0:1788390448.215069:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098037760:0@lo:400:kworker.0 00000100:00100000:2.0:1788390448.215071:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788390448.215084:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098038144:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788390448.215090:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87af4000 x1875263098038272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390448.215103:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098038272:0@lo:400:kworker.0 00000100:00100000:3.0:1788390448.215127:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098037248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390448.215134:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098038144:12345-0@lo:400:kworker.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390448.215142:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788390448.215144:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098037632 00000100:00100000:1.0:1788390448.215149:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098037632 00000100:00100000:2.0:1788390448.215195:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788390448.215203:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098037632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390448.215230:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098037632:12345-0@lo:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390448.215235:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788390448.215704:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390448.215729:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098037632:0@lo:400:kworker.0 00000100:00100000:0.0:1788390448.215741:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098038144:0@lo:400:kworker.0 00010000:00010000:0.0:1788390448.274099:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390448.800362:0:14226:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788390448.800371:0:14226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390448.800405:0:14226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788390448.800413:0:14226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390448.863918:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390448.864072:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088539136 00000100:00100000:1.0:1788390448.864083:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088539136 00000100:00100000:1.0:1788390448.864161:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 93 00000100:00100000:1.0:1788390448.864172:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:11324:x1875263088539136:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390448.864199:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390448.864221:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be97c43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e5d expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.864370:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97c4a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.864386:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97c4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.864984:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97c4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390448.864999:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788390448.868046:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be97c43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e5d expref: 21 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.868089:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97c4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e5d expref: 20 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.868099:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:1.0:1788390448.868102:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390448.868107:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cea00, rc 0) 00000100:00100000:1.0:1788390448.868189:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:11324:x1875263088539136:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 4015us (4287us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788390448.868198:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 93 00000100:00100000:3.0:1788390448.874240:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390448.874295:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088539264 00000100:00100000:0.0:1788390448.874306:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088539264 00000100:00100000:0.0:1788390448.879217:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 94 00000100:00100000:0.0:1788390448.879234:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:11324:x1875263088539264:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:0.0:1788390448.879317:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879350:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879362:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879387:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879396:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879402:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879687:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879696:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879704:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390448.879769:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879784:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879790:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879797:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879803:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390448.879808:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879816:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879828:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390448.879830:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390448.879834:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879840:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97c58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879849:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879854:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879865:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879870:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390448.879873:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879878:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879884:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f86567e00) 00010000:00010000:0.0:1788390448.879886:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390448.879889:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.879894:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.880016:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.880023:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.880037:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.880041:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390448.880044:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.880060:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.880068:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390448.880070:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390448.880073:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.880078:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390448.880268:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:11324:x1875263088539264:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 1036us (6034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390448.880276:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 94 00000100:00100000:3.0:1788390448.910296:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390448.910342:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088539520 00000100:00100000:3.0:1788390448.910415:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088539520 00000100:00100000:3.0:1788390448.910467:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 95 00000100:00100000:3.0:1788390448.910477:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:11327:x1875263088539520:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390448.910496:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390448.910516:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97c6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e64 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910586:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910601:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910613:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910628:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910636:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910643:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910757:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910770:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910777:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390448.910786:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788390448.910855:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910862:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910868:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910874:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cec00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390448.910879:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910886:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910901:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:3.0:1788390448.910904:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390448.910909:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910915:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97c74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910925:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910936:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910942:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910948:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfa00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390448.910951:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910957:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910964:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fb7863300) 00010000:00010000:3.0:1788390448.910967:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390448.910969:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.910975:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be97c7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.911012:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97c6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e64 expref: 23 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.911025:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e64 expref: 22 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.911710:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:3.0:1788390448.911712:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390448.911720:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cee00, rc 0) 00000100:00100000:3.0:1788390448.911784:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:11327:x1875263088539520:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 1308us (1497us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788390448.911793:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 95 00000100:00100000:0.0:1788390448.916245:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390448.917548:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088539648 00000100:00100000:1.0:1788390448.917560:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088539648 00000100:00100000:1.0:1788390448.917620:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 96 00000100:00100000:1.0:1788390448.917631:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:11327:x1875263088539648:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:1.0:1788390448.917704:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.917722:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.917735:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.917772:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.917780:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.917799:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.917806:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cf800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390448.917810:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.917818:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.917832:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:1.0:1788390448.917836:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390448.917840:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.917847:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97c90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390448.917918:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:11327:x1875263088539648:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 287us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390448.917926:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 96 00000100:00100000:1.0:1788390448.920849:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390448.920977:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088539904 00000100:00100000:3.0:1788390448.920987:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088539904 00000100:00100000:3.0:1788390448.922022:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:3.0:1788390448.922046:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ad2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:11327:x1875263088539904:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390448.922649:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ad2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:11327:x1875263088539904:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 606us (1808us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788390448.922657:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:3.0:1788390448.942538:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390448.942589:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088540160 00000100:00100000:0.0:1788390448.942599:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088540160 00000100:00100000:0.0:1788390448.942654:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 97 00000100:00100000:0.0:1788390448.942666:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:10846:x1875263088540160:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:0.0:1788390448.942691:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390448.942710:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c97 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.942809:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.942824:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e64 expref: 24 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.942850:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.942934:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e64 expref: 24 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.942948:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e64 expref: 24 pid: 8996 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390448.942962:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098038528:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390448.943056:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390448.944758:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390448.944759:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098038528:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390448.944786:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390448.944944:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088540288 00000100:00100000:1.0:1788390448.944952:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088540288 00010000:00010000:1.0:1788390448.944988:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e64 expref: 25 pid: 8996 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390448.945022:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 65 00000100:00100000:1.0:1788390448.945042:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:2405:x1875263088540288:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390448.945079:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390448.945088:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e64 expref: 25 pid: 8996 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.945102:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e64 expref: 25 pid: 8996 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.945123:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be97c82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e64 expref: 25 pid: 8996 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.945137:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:1.0:1788390448.945141:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.945150:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.945157:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390448.945189:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390448.945212:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.945219:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390448.945234:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000100:00100000:1.0:1788390448.945241:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:2405:x1875263088540288:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 210us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390448.945251:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 65 00010000:00010000:0.0:1788390448.945383:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97c97 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e6b expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.945398:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e6b expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.945418:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:0.0:1788390448.945421:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390448.945423:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81c00, rc 0) 00000100:00100000:0.0:1788390448.945457:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:10846:x1875263088540160:12345-192.168.202.11@tcp:101:bash.0 Request processed in 2793us (2929us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788390448.945464:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 97 00000100:00100000:3.0:1788390448.946707:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390448.946747:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088540416 00000100:00100000:0.0:1788390448.946754:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088540416 00000100:00100000:0.0:1788390448.946788:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 98 00000100:00100000:0.0:1788390448.946794:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:10846:x1875263088540416:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:0.0:1788390448.946811:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390448.946823:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97cac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e72 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.946846:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97cb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.946853:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.946860:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.946963:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97cac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e72 expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.946987:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e72 expref: 25 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.947001:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:0.0:1788390448.947004:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390448.947008:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81200, rc 0) 00000100:00100000:0.0:1788390448.947059:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:10846:x1875263088540416:12345-192.168.202.11@tcp:101:bash.0 Request processed in 263us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390448.947065:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 98 00000100:00100000:1.0:1788390448.948652:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390448.948750:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088540672 00000100:00100000:3.0:1788390448.948757:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088540672 00000100:00100000:3.0:1788390448.948808:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 99 00000100:00100000:3.0:1788390448.948820:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:10846:x1875263088540672:12345-192.168.202.11@tcp:36:bash.0 00010000:00010000:3.0:1788390448.949050:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.949076:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.949087:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390448.949131:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788390448.949169:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4ca8c24 reply state 0000000035218f6f transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.949194:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.949203:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:3.0:1788390448.949206:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390448.949209:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788390448.949278:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1788390448.949416:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:10846:x1875263088540672:12345-192.168.202.11@tcp:36:bash.0 Request processed in 598us (769us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788390448.949427:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 99 00000020:00080000:3.0:1788390448.949432:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788390448.950596:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390448.950659:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088540800 00000100:00100000:0.0:1788390448.950666:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088540800 00000100:00100000:0.0:1788390448.950717:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 100 00000100:00100000:0.0:1788390448.950727:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:10846:x1875263088540800:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:0.0:1788390448.950743:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390448.950758:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97cc1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e79 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.950802:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e79 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.950816:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e79 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390448.950833:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:0.0:1788390448.950837:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390448.950840:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81400, rc 0) 00000100:00100000:0.0:1788390448.950894:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:10846:x1875263088540800:12345-192.168.202.11@tcp:101:bash.0 Request processed in 168us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390448.950914:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 100 00000100:00100000:0.0:1788390448.953337:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390448.953422:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088540928 00000100:00100000:3.0:1788390448.953432:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088540928 00000100:00100000:3.0:1788390448.953482:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 41 00000100:00100000:3.0:1788390448.953498:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:10846:x1875263088540928:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390448.953514:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390448.953538:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e80 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390448.953565:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a98ac2e, atime: 0x6a98ac2d, ctime: 0x6a98ac2e, blocks: 0x8 00010000:00010000:3.0:1788390448.953583:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=269s v=(0 0) 00010000:00010000:3.0:1788390448.953588:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390448.953596:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e80 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.953616:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e80 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390448.953640:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfa00, rc 0) 00000100:00100000:3.0:1788390448.953681:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:10846:x1875263088540928:12345-192.168.202.11@tcp:101:bash.0 Request processed in 184us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390448.953687:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 41 00000100:00100000:1.0:1788390448.957294:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390448.957441:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088541056 00000100:00100000:2.0:1788390448.957451:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088541056 00002000:00010000:2.0:1788390448.957506:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788390448.957511:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984f85ae3100 with x1875263088541056 ext(0->18446744073709551615) 00002000:00010000:2.0:1788390448.957522:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984f85ae3100. 00000100:00100000:2.0:1788390448.957611:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 1 00000100:00100000:2.0:1788390448.957622:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088541056:12345-192.168.202.11@tcp:10:bash.0 00002000:00010000:2.0:1788390448.957880:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788390448.957885:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788390446 -> 1788390448 00002000:00010000:2.0:1788390448.957887:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788390445 -> 1788390445 00002000:00010000:2.0:1788390448.957890:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788390446 -> 1788390448 00002000:00010000:2.0:1788390448.957892:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788390448.957954:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088541056:12345-192.168.202.11@tcp:10:bash.0 Request processed in 333us (666us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788390448.957962:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 1 00002000:00010000:2.0:1788390448.957967:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788390448.957970:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984f85ae3100 with x1875263088541056 ext(0->18446744073709551615) 00002000:00010000:2.0:1788390448.957975:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984f85ae3100. 00000100:00100000:2.0:1788390449.006917:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.006977:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088541184 00000100:00100000:0.0:1788390449.006986:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088541184 00000100:00100000:0.0:1788390449.007068:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 101 00000100:00080000:1.0:1788390449.007074:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390449.007077:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:11341:x1875263088541184:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:0.0:1788390449.007134:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007146:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007154:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007163:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007168:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007171:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007226:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007231:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007235:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390449.007291:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007300:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007304:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007308:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007312:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.007314:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007343:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007352:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390449.007354:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.007358:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007361:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97ccf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007370:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007375:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007383:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007386:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.007395:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007737:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007745:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f86567500) 00010000:00010000:0.0:1788390449.007747:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.007749:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007753:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97cd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007764:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007767:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007770:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007773:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.007775:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007786:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007791:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:0.0:1788390449.007792:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.007794:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.007797:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97cdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.007947:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:11341:x1875263088541184:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 871us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.007953:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 101 00000100:00100000:0.0:1788390449.027514:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.027926:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088541440 00000100:00100000:2.0:1788390449.027935:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088541440 00000100:00100000:2.0:1788390449.027997:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 102 00000100:00100000:2.0:1788390449.028019:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:11344:x1875263088541440:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390449.028050:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.028070:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97ce4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e87 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028144:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028172:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028183:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028197:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028202:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028208:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028345:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97cf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028355:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028362:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390449.028371:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788390449.028445:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028452:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028459:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028473:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390449.028477:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028485:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028497:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:2.0:1788390449.028501:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390449.028506:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028512:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97ceb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028523:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028527:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028531:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028534:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390449.028536:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028539:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028551:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f8c933100) 00010000:00010000:2.0:1788390449.028553:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390449.028555:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028561:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97cf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028599:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97ce4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e87 expref: 33 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028612:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e87 expref: 32 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.028618:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:2.0:1788390449.028620:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788390449.028623:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5000, rc 0) 00000100:00100000:2.0:1788390449.028742:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:11344:x1875263088541440:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 735us (1237us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788390449.028750:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 102 00000100:00100000:1.0:1788390449.035588:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.035675:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088541568 00000100:00100000:0.0:1788390449.035686:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088541568 00000100:00100000:0.0:1788390449.035742:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 103 00000100:00100000:0.0:1788390449.035753:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:11344:x1875263088541568:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:0.0:1788390449.036279:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.036297:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e6b expref: 32 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.036307:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.036377:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e6b expref: 32 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.036545:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e6b expref: 32 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.036560:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098038656:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390449.036661:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390449.040496:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.040677:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088541824 00000100:00100000:3.0:1788390449.040688:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088541824 00000100:00100000:3.0:1788390449.040742:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:3.0:1788390449.040753:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+33:6165:x1875263088541824:12345-192.168.202.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788390449.041034:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+34:6165:x1875263088541824:12345-192.168.202.11@tcp:35:ldlm_bl.0 Request processed in 273us (537us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788390449.041044:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:0.0:1788390449.041047:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098038656:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390449.041075:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.042852:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.042929:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088541952 00000100:00100000:0.0:1788390449.042937:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088541952 00010000:00010000:0.0:1788390449.042969:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e6b expref: 34 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.043005:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 66 00000100:00100000:0.0:1788390449.043015:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+34:2404:x1875263088541952:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390449.043040:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390449.043049:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e6b expref: 34 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.043062:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e6b expref: 34 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.043094:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97c9e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e6b expref: 34 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.043131:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:0.0:1788390449.043136:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.043150:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.043157:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.043188:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390449.043244:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+33:2404:x1875263088541952:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 230us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.043252:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 66 00010000:00010000:3.0:1788390449.043625:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.043635:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.043668:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.043675:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.043681:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.043697:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390449.043701:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.043708:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.043718:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:3.0:1788390449.043721:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390449.043725:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.043732:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97d07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.043788:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:11344:x1875263088541568:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 8036us (8209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.043796:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 103 00000100:00100000:3.0:1788390449.045452:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.045598:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088542208 00000100:00100000:2.0:1788390449.045606:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088542208 00000100:00100000:2.0:1788390449.045644:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00100000:2.0:1788390449.045651:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:11344:x1875263088542208:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:2.0:1788390449.045818:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+33:11344:x1875263088542208:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 167us (372us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788390449.045824:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00100000:1.0:1788390449.096558:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.096659:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088542464 00000100:00100000:0.0:1788390449.096669:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088542464 00000100:00100000:0.0:1788390449.096740:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 104 00000100:00100000:0.0:1788390449.096751:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+33:11355:x1875263088542464:12345-192.168.202.11@tcp:101:cat.0 00010000:00010000:0.0:1788390449.096778:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390449.096799:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97d0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.096883:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.096898:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.096920:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.096948:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.096955:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.096962:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097090:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97d23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097100:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097107:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390449.097117:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788390449.097197:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097205:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097211:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097217:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.097222:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097239:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097252:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390449.097255:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.097259:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097265:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97d15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097279:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097285:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097291:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097296:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.097299:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097305:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097312:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f86567500) 00010000:00010000:0.0:1788390449.097314:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.097316:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097394:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97d1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097446:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97d0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e8e expref: 36 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097459:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97d23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e8e expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.097466:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:0.0:1788390449.097469:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390449.097471:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81e00, rc 0) 00000100:00100000:0.0:1788390449.097528:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:11355:x1875263088542464:12345-192.168.202.11@tcp:101:cat.0 Request processed in 778us (980us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788390449.097535:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 104 00000100:00100000:1.0:1788390449.106498:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.106598:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088542720 00000100:00100000:2.0:1788390449.106607:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088542720 00000100:00100000:2.0:1788390449.106700:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:2.0:1788390449.106709:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:11355:x1875263088542720:12345-192.168.202.11@tcp:35:cat.0 00000100:00100000:2.0:1788390449.106988:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+36:11355:x1875263088542720:12345-192.168.202.11@tcp:35:cat.0 Request processed in 280us (676us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788390449.106995:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:3.0:1788390449.123079:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.124147:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088542976 00000100:00100000:2.0:1788390449.124159:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088542976 00000100:00100000:2.0:1788390449.124219:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 105 00000100:00100000:2.0:1788390449.124226:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+36:11356:x1875263088542976:12345-192.168.202.11@tcp:36:rm.0 00010000:00010000:2.0:1788390449.124274:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788390449.124297:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97cc1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e79 expref: 36 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124313:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97d23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e8e expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124360:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97cf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e87 expref: 34 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124371:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97cb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e72 expref: 33 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124378:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:2.0:1788390449.124382:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390449.124399:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124427:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124438:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124454:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124461:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124468:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124540:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124547:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124555:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390449.124730:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788390449.124737:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 269682414783ns, next at 270682413216ns, rc = 0 00010000:00010000:2.0:1788390449.124768:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124774:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124786:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124791:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124795:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124798:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124819:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390449.124833:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124838:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124844:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124849:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390449.124853:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124861:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124870:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:2.0:1788390449.124872:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788390449.124881:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124885:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97d3f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124895:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124898:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124902:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124905:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390449.124906:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124909:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124914:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:2.0:1788390449.124915:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390449.124916:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124919:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97d31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390449.124924:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba264df2 reply state 000000004bff0109 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124938:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.124942:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f8c933100) 00010000:00010000:2.0:1788390449.124943:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390449.124945:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788390449.125198:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390449.125203:0:13157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.125207:0:13157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5a00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390449.125210:0:13157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.125214:0:13157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.125220:0:13157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:1.0:1788390449.125221:0:13157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788390449.125223:0:13157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.125227:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97d46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.125235:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390449.125236:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390449.125237:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390449.128154:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+34:11356:x1875263088542976:12345-192.168.202.11@tcp:36:rm.0 Request processed in 3918us (5079us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788390449.128163:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 105 00000100:00100000:1.0:1788390449.165850:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.166022:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088543232 00000100:00100000:3.0:1788390449.166063:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088543232 00000100:00100000:3.0:1788390449.166129:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 106 00000100:00100000:3.0:1788390449.166139:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+34:11362:x1875263088543232:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390449.166163:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390449.166184:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97d4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e95 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166305:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166342:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166354:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166366:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166374:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166380:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390449.166691:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788390449.166842:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166848:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166853:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166875:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166888:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166892:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166895:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390449.166898:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166903:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166911:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:3.0:1788390449.166914:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390449.166916:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166920:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97d54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390449.166930:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e10a0b70 reply state 0000000095d1c9d6 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166937:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166940:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f8c933100) 00010000:00010000:3.0:1788390449.166942:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390449.166944:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788390449.166964:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97d4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e95 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166978:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e95 expref: 36 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.166983:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:3.0:1788390449.166984:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390449.166986:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf600, rc 0) 00000100:00100000:3.0:1788390449.167062:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:11362:x1875263088543232:12345-192.168.202.11@tcp:101:bash.0 Request processed in 924us (1221us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788390449.167071:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 106 00000100:00100000:1.0:1788390449.170260:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.170377:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088543360 00000100:00100000:2.0:1788390449.170387:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088543360 00000100:00080000:1.0:1788390449.170453:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390449.170459:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 42 00000100:00100000:2.0:1788390449.170472:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbf8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088543360:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390449.170490:0:8798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.170511:0:8798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243e9c expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390449.170550:0:8798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390449.170570:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=269s v=(0 0) 00010000:00010000:2.0:1788390449.170575:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390449.170584:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e9c expref: 8 pid: 8798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.170603:0:8798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e9c expref: 8 pid: 8798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.170638:0:8798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4a00, rc 0) 00000100:00100000:2.0:1788390449.170695:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbf8ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088543360:12345-192.168.202.11@tcp:101:bash.0 Request processed in 226us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.170702:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 42 00000100:00100000:2.0:1788390449.173264:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.173512:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088543488 00000100:00100000:1.0:1788390449.173522:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088543488 00000100:00100000:1.0:1788390449.173589:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 43 00000100:00100000:1.0:1788390449.173599:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:11362:x1875263088543488:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:1.0:1788390449.173631:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390449.173651:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ea3 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.173680:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e9c expref: 9 pid: 8798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.173690:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390449.173694:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390449.173699:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.173748:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e9c expref: 9 pid: 8798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.173763:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e9c expref: 9 pid: 8798 timeout: 369 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.173778:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1875263098038784:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390449.173886:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05600 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.177732:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.177829:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088543616 00000100:00100000:1.0:1788390449.177839:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088543616 00010000:00010000:1.0:1788390449.177880:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e9c expref: 10 pid: 8798 timeout: 369 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.177916:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00100000:1.0:1788390449.177941:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2405:x1875263088543616:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390449.177957:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390449.177979:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e9c expref: 10 pid: 8798 timeout: 369 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.177993:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e9c expref: 10 pid: 8798 timeout: 369 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.178019:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390449.178023:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390449.178043:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.178053:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.178092:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.178107:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1902300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6478:1875263098038912:192.168.202.11@tcp:105: 00000100:00100000:1.0:1788390449.178183:0:6478:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b05d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788390449.178318:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be97d70 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e9c expref: 10 pid: 8798 timeout: 369 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.178345:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1875263098038784:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390449.178367:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.178378:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cfa00, rc 0) 00000100:00100000:0.0:1788390449.178413:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:11362:x1875263088543488:12345-192.168.202.11@tcp:101:bash.0 Request processed in 4815us (5158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.178429:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 43 00000100:00100000:2.0:1788390449.181018:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.181138:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088543872 00000100:00100000:3.0:1788390449.181148:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088543872 00000100:00100000:3.0:1788390449.181202:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:3.0:1788390449.181212:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:11362:x1875263088543872:12345-192.168.202.11@tcp:35:bash.0 00000100:00100000:3.0:1788390449.181653:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:11362:x1875263088543872:12345-192.168.202.11@tcp:35:bash.0 Request processed in 440us (641us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788390449.181661:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:0.0:1788390449.182253:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1902300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6478:1875263098038912:192.168.202.11@tcp:105: 00010000:00010000:0.0:1788390449.182275:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390449.182371:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088543616:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 4432us (4661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.182380:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00100000:2.0:1788390449.282925:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.283481:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088544000 00000100:00100000:1.0:1788390449.283492:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088544000 00000100:00100000:1.0:1788390449.283653:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 107 00000100:00100000:1.0:1788390449.283664:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:11378:x1875263088544000:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390449.283688:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390449.283721:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97d7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243eaa expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.283789:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be97d85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.283803:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be97d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.283815:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be97d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390449.283857:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788390449.283876:0:12122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390449.283896:0:12122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be97d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.283929:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97d7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eaa expref: 40 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.283949:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be97d85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eaa expref: 39 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.283957:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:1.0:1788390449.283960:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390449.283964:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5ce000, rc 0) 00000100:00100000:1.0:1788390449.284041:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:11378:x1875263088544000:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 378us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390449.284049:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 107 00000100:00100000:1.0:1788390449.288805:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.295978:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088544256 00000100:00100000:2.0:1788390449.295995:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088544256 00000100:00100000:2.0:1788390449.296072:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 108 00000100:00100000:2.0:1788390449.296083:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:11378:x1875263088544256:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390449.296104:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.296125:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97d8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243eb1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.296231:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97d93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.296245:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.296255:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390449.296266:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788390449.296421:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97d8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eb1 expref: 42 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.296454:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97d93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eb1 expref: 41 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.296462:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:2.0:1788390449.296466:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390449.296469:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:2.0:1788390449.296790:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+41:11378:x1875263088544256:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 708us (7994us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788390449.296798:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 108 00010000:00010000:0.0:1788390449.298942:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390449.299203:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.299288:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088544512 00000100:00100000:3.0:1788390449.299310:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088544512 00000100:00100000:3.0:1788390449.299565:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 109 00000100:00100000:3.0:1788390449.299576:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+41:11378:x1875263088544512:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390449.299601:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390449.299619:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97da1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243eb8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.299717:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97da8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.299741:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97da8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.299753:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97da8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390449.299766:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788390449.299867:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97da1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eb8 expref: 44 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.299887:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97da8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eb8 expref: 43 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.299896:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:3.0:1788390449.299899:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788390449.299902:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20ce400, rc 0) 00000100:00100000:3.0:1788390449.300042:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:11378:x1875263088544512:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 467us (847us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788390449.300050:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 109 00000100:00100000:3.0:1788390449.305511:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.307465:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088544640 00000100:00100000:1.0:1788390449.307480:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088544640 00000100:00100000:0.0:1788390449.307675:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:0.0:1788390449.307688:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:2404:x1875263088544640:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390449.307707:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390449.307732:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97d93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eb1 expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.307754:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:0.0:1788390449.307760:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390449.307833:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+42:2404:x1875263088544640:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 148us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.307840:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:0.0:1788390449.310469:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.310704:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088544768 00000100:00100000:2.0:1788390449.310714:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088544768 00000100:00100000:2.0:1788390449.310806:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 44 00000100:00100000:2.0:1788390449.310816:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2407:x1875263088544768:12345-192.168.202.11@tcp:1:lfs.0 00010000:00010000:2.0:1788390449.310858:0:8798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.310877:0:8798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.310886:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390449.310890:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390449.310895:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.310950:0:8798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.310964:0:8798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 8 pid: 8407 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.310978:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8798:1875263098039040:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390449.311082:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390449.313474:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.313603:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088544896 00000100:00100000:0.0:1788390449.313614:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088544896 00002000:00100000:0.0:1788390449.313678:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff984fbb16e300 x1875263088544896/t0(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:65/0 lens 504/0 e 0 to 0 dl 1788390460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390449.313689:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984fbb16e300 with x1875263088544896 ext(0->8) 00010000:00010000:0.0:1788390449.313699:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 9 pid: 8407 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.313732:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 9 pid: 8407 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390449.313740:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff984fbb16e300 00000100:00100000:0.0:1788390449.313833:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 1 00000100:00100000:0.0:1788390449.313845:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088544896:12345-192.168.202.11@tcp:4:lfs.0 00000100:00100000:1.0:1788390449.314744:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8798:1875263098039040:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390449.314774:0:8798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.314938:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2405:x1875263088544896:12345-192.168.202.11@tcp:4:lfs.0 Request processed in 1094us (1471us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788390449.314948:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 1 00002000:00100000:0.0:1788390449.314959:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff984fbb16e300 x1875263088544896/t4294967303(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:65/0 lens 504/448 e 0 to 0 dl 1788390460 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390449.314969:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984fbb16e300 with x1875263088544896 ext(0->8) 00010000:00010000:0.0:1788390449.314977:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 11 pid: 8407 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.314992:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 11 pid: 8407 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390449.315000:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff984fbb16e300 00000100:00100000:2.0:1788390449.316790:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.316842:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088545024 00000100:00100000:3.0:1788390449.316851:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088545024 00010000:00010000:3.0:1788390449.316887:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 11 pid: 8407 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.316957:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:3.0:1788390449.316968:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2406:x1875263088545024:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390449.316990:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788390449.317006:0:10369:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788390449.317009:0:10369:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788390449 00002000:00010000:3.0:1788390449.317011:0:10369:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788390449 00002000:00010000:3.0:1788390449.317013:0:10369:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788390449 00002000:00010000:3.0:1788390449.317015:0:10369:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788390449.317021:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 11 pid: 8407 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.317046:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 11 pid: 8407 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.317071:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be97d77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ea3 expref: 11 pid: 8407 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.317086:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390449.317091:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390449.317097:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.317177:0:10369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.317210:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390449.317268:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2406:x1875263088545024:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 303us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.317275:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 68 00010000:00010000:1.0:1788390449.317309:0:8798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.317318:0:8798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.317350:0:8798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.317356:0:8798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.317361:0:8798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.317365:0:8798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390449.317371:0:8798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.317377:0:8798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.317396:0:8798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.317412:0:8798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97db6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.317466:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2407:x1875263088544768:12345-192.168.202.11@tcp:1:lfs.0 Request processed in 6651us (7007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390449.317474:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 44 00000100:00100000:1.0:1788390449.319833:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.319898:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088545280 00000100:00100000:2.0:1788390449.319908:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088545280 00000100:00100000:2.0:1788390449.319994:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 26 00000100:00100000:2.0:1788390449.320004:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb604d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+42:11378:x1875263088545280:12345-192.168.202.11@tcp:35:lfs.0 00000004:00010000:2.0:1788390449.320078:0:6496:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97da8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eb8 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390449.320313:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788390449.320421:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788390449.320773:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788390449.320810:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.320825:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e95 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.320835:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.320874:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e95 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.320888:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e95 expref: 46 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.320902:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6496:1875263098039168:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390449.320981:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954000 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.323671:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.323720:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088545408 00000100:00100000:1.0:1788390449.323731:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088545408 00010000:00010000:1.0:1788390449.323769:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e95 expref: 47 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.323819:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6496:1875263098039168:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390449.323841:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.324608:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 69 00000100:00100000:0.0:1788390449.324623:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+47:2405:x1875263088545408:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390449.324640:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390449.324649:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e95 expref: 47 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.324676:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e95 expref: 47 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.324699:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97d62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e95 expref: 47 pid: 6494 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.324716:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:0.0:1788390449.324721:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.324731:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.324739:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.324806:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390449.324896:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+46:2405:x1875263088545408:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 278us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.324905:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 69 00010000:00010000:3.0:1788390449.324949:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.324956:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390449.325079:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1788390449.325287:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1788390449.325397:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6496:1875263098039296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788390449.325450:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390449.325479:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a5ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390449.325553:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098039296 00000100:00100000:0.0:1788390449.325560:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098039296 00000100:00100000:0.0:1788390449.325610:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788390449.325618:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6496:x1875263098039296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788390449.325689:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6496:x1875263098039296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.325695:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788390449.325770:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6496:1875263098039296:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788390449.325874:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788390449.325913:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6496:1875263098039424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788390449.325938:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390449.325963:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a5c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788390449.326012:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098039424 00000100:00100000:0.0:1788390449.326016:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098039424 00000100:00100000:0.0:1788390449.326056:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788390449.326063:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6496:x1875263098039424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1788390449.326111:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390449.326658:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6496:x1875263098039424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 593us (717us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788390449.326667:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788390449.326710:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6496:1875263098039424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788390449.326746:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788390449.326785:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.326792:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.326796:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.326808:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390449.326811:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.326816:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.326826:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:3.0:1788390449.326828:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788390449.326831:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.326837:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97dbd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390449.326919:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788390449.326963:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788390449.326971:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 269884649773ns, next at 270884648411ns, rc = 0 00000001:00080000:3.0:1788390449.326975:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788390449.326993:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fb7863d00) 00010000:00010000:3.0:1788390449.326996:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788390449.327001:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97da8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eb8 expref: 50 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.327549:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb604d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+49:11378:x1875263088545280:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 7545us (7722us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788390449.327558:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 26 00000020:00080000:3.0:1788390449.327562:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788390449.329414:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.329456:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088545536 00000100:00100000:1.0:1788390449.329466:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088545536 00000100:00100000:1.0:1788390449.329514:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 110 00000100:00100000:1.0:1788390449.329524:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+49:11378:x1875263088545536:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390449.329545:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390449.329564:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97dc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ebf expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.329640:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ebf expref: 50 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.329655:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ebf expref: 50 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.329671:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:1.0:1788390449.329674:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390449.329677:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cf400, rc 0) 00000100:00100000:1.0:1788390449.329718:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+50:11378:x1875263088545536:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 196us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390449.329725:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 110 00000100:00100000:1.0:1788390449.338274:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.338352:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088545792 00000100:00100000:3.0:1788390449.338363:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088545792 00000100:00100000:3.0:1788390449.338736:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 27 00000100:00100000:0.0:1788390449.338746:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1788390449.338750:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+50:11378:x1875263088545792:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:0.0:1788390449.338761:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1788390449.339069:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+51:11378:x1875263088545792:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 321us (803us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788390449.339078:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 27 00000100:00100000:2.0:1788390449.396437:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.396538:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088545920 00000100:00100000:0.0:1788390449.396549:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088545920 00000100:00100000:0.0:1788390449.396627:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 111 00000100:00100000:0.0:1788390449.396636:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+51:11388:x1875263088545920:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:0.0:1788390449.396706:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396722:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396733:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396743:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396749:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396755:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396822:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396831:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396851:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390449.396898:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396910:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396916:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396923:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396929:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.396933:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396940:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396951:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390449.396954:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.396959:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396964:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97dcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396977:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396988:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.396994:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397000:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.397003:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397010:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397018:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f8c933100) 00010000:00010000:0.0:1788390449.397020:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.397056:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397063:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97dd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397073:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397079:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397085:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397090:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.397098:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397160:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397171:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.397173:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.397176:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.397180:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97dd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.397310:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+51:11388:x1875263088545920:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 674us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.397318:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 111 00000100:00100000:2.0:1788390449.430413:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.430572:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088546176 00000100:00100000:3.0:1788390449.430582:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088546176 00000100:00100000:3.0:1788390449.430643:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 112 00000100:00100000:3.0:1788390449.430654:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+51:11391:x1875263088546176:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390449.430675:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390449.430695:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97de0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ec6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.430765:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.430779:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.430792:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.430804:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.430813:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.430840:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.430955:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.430964:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.430972:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390449.430981:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788390449.431088:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.431098:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.431104:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.431111:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cec00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390449.431116:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.431123:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.431138:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:3.0:1788390449.431142:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390449.431154:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.431161:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97de7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.431176:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.432122:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.432128:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.432134:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfe00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390449.432137:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.432145:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.432156:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f8c933100) 00010000:00010000:3.0:1788390449.432159:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390449.432162:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.432168:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97dee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.432229:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97de0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ec6 expref: 54 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.432264:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ec6 expref: 53 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.432272:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:3.0:1788390449.432274:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390449.432277:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf600, rc 0) 00000100:00100000:3.0:1788390449.432382:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+53:11391:x1875263088546176:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 1727us (1977us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788390449.432394:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 112 00000100:00100000:1.0:1788390449.436734:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.436800:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088546304 00000100:00100000:2.0:1788390449.436810:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088546304 00000100:00100000:2.0:1788390449.436873:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 113 00000100:00100000:2.0:1788390449.436884:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+53:11391:x1875263088546304:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:2.0:1788390449.436954:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.436974:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.436985:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.437036:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.437063:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.437070:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.437076:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390449.437081:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.437089:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.437102:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390449.437106:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390449.437110:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.437115:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.437403:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+53:11391:x1875263088546304:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 518us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.437412:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 113 00000100:00100000:2.0:1788390449.448692:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.448762:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088546560 00000100:00100000:3.0:1788390449.448773:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088546560 00000100:00100000:3.0:1788390449.448825:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:3.0:1788390449.448836:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+53:11391:x1875263088546560:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390449.449118:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:11391:x1875263088546560:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 282us (438us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1788390449.449127:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:1.0:1788390449.502768:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.502942:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088546816 00000100:00100000:0.0:1788390449.502952:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088546816 00000100:00100000:0.0:1788390449.503056:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 114 00000100:00100000:0.0:1788390449.503065:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:11401:x1875263088546816:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:0.0:1788390449.503086:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390449.503089:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788390449.503111:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be97d85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243eaa expref: 54 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.503129:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390449.503134:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390449.503147:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97e0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ecd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.503291:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.503306:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ec6 expref: 54 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.503315:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.503412:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ec6 expref: 54 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.503427:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ec6 expref: 54 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.503440:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098039552:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390449.503538:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f830716c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390449.507835:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098039552:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390449.507866:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.508339:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.508527:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088546944 00000100:00100000:0.0:1788390449.508535:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088546944 00010000:00010000:0.0:1788390449.508571:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ec6 expref: 55 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.508614:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 70 00000100:00100000:0.0:1788390449.508642:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+55:2404:x1875263088546944:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390449.508659:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390449.508666:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ec6 expref: 55 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.508678:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ec6 expref: 55 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.508700:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be97df5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ec6 expref: 55 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.508719:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.508725:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.508737:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.508745:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.508863:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390449.508932:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:2404:x1875263088546944:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 290us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.508939:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 70 00010000:00010000:2.0:1788390449.509794:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.509802:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390449.509830:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788390449.509960:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97e0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ecd expref: 55 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.509974:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ecd expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.509980:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390449.509982:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390449.509984:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81000, rc 0) 00000100:00100000:2.0:1788390449.510036:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:11401:x1875263088546816:12345-192.168.202.11@tcp:101:bash.0 Request processed in 6972us (7276us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788390449.510041:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 114 00000100:00100000:1.0:1788390449.512070:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.512116:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088547072 00000100:00100000:3.0:1788390449.512125:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088547072 00000100:00100000:3.0:1788390449.512173:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 115 00000100:00100000:3.0:1788390449.512187:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:11401:x1875263088547072:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390449.512212:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390449.512234:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97e1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ed4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.512260:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.512283:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.512291:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.512616:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be97e1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ed4 expref: 56 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.512629:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ed4 expref: 55 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.512635:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:3.0:1788390449.512637:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788390449.512639:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfe00, rc 0) 00000100:00100000:3.0:1788390449.512730:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+55:11401:x1875263088547072:12345-192.168.202.11@tcp:101:bash.0 Request processed in 549us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.512737:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 115 00000100:00100000:3.0:1788390449.514738:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.514875:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088547328 00000100:00100000:2.0:1788390449.514885:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088547328 00000100:00100000:2.0:1788390449.514947:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 116 00000100:00100000:2.0:1788390449.514959:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+55:11401:x1875263088547328:12345-192.168.202.11@tcp:36:bash.0 00010000:00010000:2.0:1788390449.515165:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.515179:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.515195:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390449.515242:0:12122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788390449.515273:0:12122:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b152f77 reply state 0000000081db08d4 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.515285:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.515292:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390449.515294:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390449.515297:0:12122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390449.516013:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:11401:x1875263088547328:12345-192.168.202.11@tcp:36:bash.0 Request processed in 1053us (1279us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788390449.516031:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 116 00000020:00080000:2.0:1788390449.516037:0:12122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788390449.517541:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.517582:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088547456 00000100:00100000:2.0:1788390449.517592:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088547456 00000100:00100000:2.0:1788390449.517638:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 117 00000100:00100000:2.0:1788390449.517645:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:11401:x1875263088547456:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390449.517664:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.517678:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97e34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243edb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.517745:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.517755:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ecd expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.517761:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.517785:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ecd expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.517807:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ecd expref: 59 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.517817:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098039680:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390449.517939:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.519424:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098039680:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390449.519448:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.520195:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.520346:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088547584 00000100:00100000:0.0:1788390449.520354:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088547584 00010000:00010000:0.0:1788390449.520439:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ecd expref: 60 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.520491:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 71 00000100:00100000:0.0:1788390449.520501:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:2405:x1875263088547584:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390449.520515:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390449.520522:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ecd expref: 60 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.520534:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ecd expref: 60 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.520554:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ecd expref: 60 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.520568:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.520573:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.520581:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.520589:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.520617:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390449.520635:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.520642:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390449.520683:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788390449.520686:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390449.520701:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.520724:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97e34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243edb expref: 60 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.520731:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:2405:x1875263088547584:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 228us (533us total) trans 0 rc 0/0 00010000:00010000:2.0:1788390449.520739:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243edb expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.520743:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 71 00010000:00010000:2.0:1788390449.520750:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390449.520758:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390449.520760:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:2.0:1788390449.520782:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:11401:x1875263088547456:12345-192.168.202.11@tcp:101:bash.0 Request processed in 3138us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.520787:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 117 00000100:00100000:1.0:1788390449.522566:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.522631:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088547840 00000100:00100000:0.0:1788390449.522647:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088547840 00000100:00100000:0.0:1788390449.522689:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00100000:0.0:1788390449.522698:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:11401:x1875263088547840:12345-192.168.202.11@tcp:35:bash.0 00000100:00100000:0.0:1788390449.522887:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11401:x1875263088547840:12345-192.168.202.11@tcp:35:bash.0 Request processed in 189us (324us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788390449.522897:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00100000:3.0:1788390449.556912:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.556989:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088547968 00000100:00100000:0.0:1788390449.557000:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088547968 00000100:00100000:0.0:1788390449.557075:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 118 00000100:00100000:0.0:1788390449.557086:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:11407:x1875263088547968:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390449.557122:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390449.557143:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ee2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.557211:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97e49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.557226:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.557237:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390449.557291:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788390449.557295:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390449.557313:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.557354:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ee2 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.557382:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97e49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ee2 expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.557388:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390449.557391:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390449.557393:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81e00, rc 0) 00000100:00100000:0.0:1788390449.557435:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11407:x1875263088547968:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 353us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.557442:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 118 00000100:00100000:1.0:1788390449.559375:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.559419:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088548096 00000100:00100000:2.0:1788390449.559428:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088548096 00000100:00100000:2.0:1788390449.559479:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 119 00000100:00100000:2.0:1788390449.559491:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11407:x1875263088548096:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390449.559509:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.559526:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97e50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ee9 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559584:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559595:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559602:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559610:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559614:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559623:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559715:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559722:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559727:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390449.559757:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788390449.559760:0:12122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390449.559772:0:12122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559780:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559786:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559790:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559794:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559797:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390449.559800:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559805:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559819:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:2.0:1788390449.559821:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390449.559824:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559828:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be97e57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559836:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559840:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559843:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559851:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390449.559853:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559857:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559861:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f8c933100) 00010000:00010000:2.0:1788390449.559862:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390449.559864:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559867:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97e5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559891:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97e50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ee9 expref: 62 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559900:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ee9 expref: 61 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.559904:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390449.559906:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390449.559907:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4800, rc 0) 00000100:00100000:2.0:1788390449.559951:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11407:x1875263088548096:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 463us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.559956:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 119 00000100:00100000:1.0:1788390449.563789:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.563825:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.563931:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088548480 00000100:00100000:2.0:1788390449.563942:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088548480 00000100:00100000:3.0:1788390449.563990:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088548224 00000100:00100000:3.0:1788390449.563998:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088548224 00000100:00100000:2.0:1788390449.564008:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 120 00000100:00100000:2.0:1788390449.564031:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:11407:x1875263088548480:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390449.564051:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788390449.564055:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:3.0:1788390449.564067:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:2406:x1875263088548224:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390449.564072:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97e6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ef0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.564081:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390449.564111:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be97e65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ee9 expref: 63 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.564153:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:3.0:1788390449.564159:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390449.564200:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.564213:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243edb expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.564220:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:2406:x1875263088548224:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 154us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.564231:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 8 00010000:00010000:2.0:1788390449.564231:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.564266:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243edb expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.564277:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243edb expref: 61 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.564286:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098039808:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390449.564370:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.566076:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098039808:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390449.566100:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.566413:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.566503:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088548608 00000100:00100000:2.0:1788390449.566510:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088548608 00010000:00010000:2.0:1788390449.566539:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243edb expref: 62 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.566577:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 72 00000100:00100000:2.0:1788390449.566587:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:2404:x1875263088548608:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390449.566601:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390449.566607:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243edb expref: 62 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.566619:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243edb expref: 62 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.566659:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243edb expref: 62 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.566676:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390449.566681:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.566699:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.566706:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.566734:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390449.566759:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.566769:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.566781:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:2404:x1875263088548608:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 195us (370us total) trans 0 rc 0/0 00000004:00200000:0.0:1788390449.566785:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00100000:2.0:1788390449.566792:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 72 00010000:00010000:0.0:1788390449.566897:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be97e6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef0 expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.566911:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef0 expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.566919:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.566922:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390449.566924:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5000, rc 0) 00000100:00100000:0.0:1788390449.566968:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11407:x1875263088548480:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 2951us (3142us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788390449.566983:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 120 00000100:00100000:1.0:1788390449.568127:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.568161:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088548864 00000100:00100000:0.0:1788390449.568167:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088548864 00000100:00100000:0.0:1788390449.568202:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:0.0:1788390449.568207:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11407:x1875263088548864:12345-192.168.202.11@tcp:103:lfs.0 00010000:00010000:0.0:1788390449.568216:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390449.568227:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be97dc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ebf expref: 61 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.568239:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.568241:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390449.568267:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11407:x1875263088548864:12345-192.168.202.11@tcp:103:lfs.0 Request processed in 59us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.568274:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:1.0:1788390449.569211:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.569274:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088548992 00000100:00100000:0.0:1788390449.569280:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088548992 00000100:00100000:0.0:1788390449.569341:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 121 00000100:00100000:0.0:1788390449.569350:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11407:x1875263088548992:12345-192.168.202.11@tcp:58:lfs.0 00010000:00010000:0.0:1788390449.569456:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.569471:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.569489:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390449.569587:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788390449.569654:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11407:x1875263088548992:12345-192.168.202.11@tcp:58:lfs.0 Request processed in 304us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.569661:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 121 00000100:00100000:3.0:1788390449.570768:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.570923:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088549120 00000100:00100000:2.0:1788390449.570930:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088549120 00000100:00100000:2.0:1788390449.570978:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 122 00000100:00100000:2.0:1788390449.570987:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:11407:x1875263088549120:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390449.571002:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.571017:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ef7 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.571079:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.571105:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef7 expref: 61 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.571122:0:12122:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.571135:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef7 expref: 61 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.571148:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390449.571152:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390449.571156:0:12122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef7 expref: 61 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.571164:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5a00, rc 0) 00000100:00100000:2.0:1788390449.571211:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11407:x1875263088549120:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 225us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.571218:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 122 00000040:00080000:2.0:1788390449.682011:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390449.682030:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390449.682083:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788390449.682093:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788390449.682225:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098039936:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390449.682342:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.686541:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8806a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098039936:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788390449.691059:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.691175:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088549248 00000100:00100000:0.0:1788390449.691185:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088549248 00000100:00100000:0.0:1788390449.691235:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 123 00000100:00100000:0.0:1788390449.691244:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11408:x1875263088549248:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788390449.691276:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788390449.691400:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11408:x1875263088549248:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 156us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.691407:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 123 00000100:00100000:3.0:1788390449.700615:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.701645:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088549376 00000100:00100000:0.0:1788390449.701657:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088549376 00000100:00100000:0.0:1788390449.701818:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 124 00000100:00100000:0.0:1788390449.701835:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11408:x1875263088549376:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788390449.701911:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702637:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702650:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702669:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702693:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702700:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702734:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702744:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702751:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390449.702800:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788390449.702805:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390449.702817:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702827:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702833:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702840:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702846:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.702850:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702864:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702877:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:0.0:1788390449.702880:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.702884:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702890:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97e8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702903:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702908:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702914:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702933:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.702936:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702942:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702949:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff984f86567500) 00010000:00010000:0.0:1788390449.702951:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.702954:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702969:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97e96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702984:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702989:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702994:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.702999:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.703002:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.703006:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.703012:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.703014:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.703017:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.703173:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97e9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.703710:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11408:x1875263088549376:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 Request processed in 1876us (3100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.703719:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 124 00000100:00100000:1.0:1788390449.710463:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.710636:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088549632 00000100:00100000:0.0:1788390449.710646:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088549632 00000100:00100000:0.0:1788390449.710708:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 125 00000100:00100000:0.0:1788390449.710719:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:11408:x1875263088549632:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390449.710750:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390449.710771:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97ea4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243efe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.710889:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.710905:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711214:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390449.711230:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788390449.711305:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711314:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711388:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711394:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.711398:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711405:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711433:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.711436:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788390449.711440:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711446:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97eab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711488:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97ea4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243efe expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711498:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:0.0:1788390449.711501:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390449.711505:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97ea4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243efe expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.711514:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80400, rc 0) 00000100:00100000:0.0:1788390449.712015:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:11408:x1875263088549632:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 1296us (1562us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1788390449.712032:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 125 00000100:00100000:1.0:1788390449.722546:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.722630:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088549760 00000100:00100000:3.0:1788390449.722641:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088549760 00000100:00100000:3.0:1788390449.722702:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 126 00000100:00100000:3.0:1788390449.722713:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:11408:x1875263088549760:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390449.722748:0:8996:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390449.722869:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:11408:x1875263088549760:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 159us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.722875:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 126 00000100:00100000:3.0:1788390449.731179:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.731275:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088550016 00000100:00100000:0.0:1788390449.731285:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088550016 00000100:00100000:0.0:1788390449.731378:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 127 00000100:00100000:0.0:1788390449.731386:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:11408:x1875263088550016:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390449.731404:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390449.731406:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788390449.731430:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97e49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ee2 expref: 62 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.731458:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390449.731461:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390449.731472:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97eb9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f05 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390449.731808:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788390449.731935:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97ec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.731948:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.731957:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.732005:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97eb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f05 expref: 64 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.732030:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f05 expref: 63 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.732038:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390449.732041:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390449.732043:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80e00, rc 0) 00000100:00100000:0.0:1788390449.732096:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:11408:x1875263088550016:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 710us (931us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788390449.732104:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 127 00000100:00100000:1.0:1788390449.741736:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.741798:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088550272 00000100:00100000:0.0:1788390449.741807:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088550272 00000100:00100000:0.0:1788390449.741846:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 128 00000100:00100000:0.0:1788390449.741853:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:11408:x1875263088550272:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788390449.741904:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390449.741930:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97ec0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f05 expref: 63 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.741949:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f86567500) 00010000:00010000:0.0:1788390449.741959:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390449.741980:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.741993:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742003:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742027:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742035:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742041:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742087:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742110:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742117:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742123:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.742127:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742135:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742142:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390449.742144:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.742147:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742151:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97ece lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742158:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742161:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742164:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742167:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.742173:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742177:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742183:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x7315741d (ffff984f86567e00) 00010000:00010000:0.0:1788390449.742185:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.742188:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.742193:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ed5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7315741d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.742262:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:11408:x1875263088550272:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 409us (534us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390449.742268:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 128 00000100:00100000:1.0:1788390449.749123:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.751169:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088550400 00000100:00100000:2.0:1788390449.751198:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088550400 00000100:00100000:2.0:1788390449.751262:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 129 00000100:00100000:2.0:1788390449.751274:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:11408:x1875263088550400:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390449.751296:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.751424:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97edc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f0c expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.751459:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.751469:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.751478:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.751581:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97edc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f0c expref: 64 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.751596:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f0c expref: 63 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.751602:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:2.0:1788390449.751605:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390449.751607:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4400, rc 0) 00000100:00100000:2.0:1788390449.751665:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:11408:x1875263088550400:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 391us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.751673:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 129 00000100:00100000:1.0:1788390449.753741:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.753827:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088550656 00000100:00100000:2.0:1788390449.753847:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088550656 00000100:00100000:2.0:1788390449.753902:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 130 00000100:00100000:2.0:1788390449.753913:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:11408:x1875263088550656:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788390449.753990:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.754007:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.754031:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390449.754181:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1788390449.754229:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb17f416 reply state 000000002a7de7b2 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.754242:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.754248:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:2.0:1788390449.754252:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788390449.754255:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390449.754427:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:11408:x1875263088550656:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 515us (693us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788390449.754435:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 130 00000100:00100000:1.0:1788390449.756548:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.757777:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088550784 00000100:00100000:2.0:1788390449.757789:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088550784 00000100:00100000:2.0:1788390449.757859:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 131 00000100:00100000:2.0:1788390449.757868:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:11408:x1875263088550784:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390449.757890:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.757923:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f13 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.757983:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f13 expref: 66 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.757998:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f13 expref: 66 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.758017:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:2.0:1788390449.758030:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390449.758034:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:2.0:1788390449.758152:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:11408:x1875263088550784:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 285us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.758159:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 131 00000100:00100000:1.0:1788390449.762130:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.762203:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088550912 00000100:00100000:3.0:1788390449.762214:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088550912 00000100:00080000:1.0:1788390449.762267:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390449.762370:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:0.0:1788390449.762383:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088550912:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788390449.762614:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088550912:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 235us (494us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788390449.762620:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:0.0:1788390449.768054:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.768432:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088551168 00000100:00100000:1.0:1788390449.768443:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088551168 00000100:00100000:2.0:1788390449.768584:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 30 00000100:00100000:2.0:1788390449.768594:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:11408:x1875263088551168:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788390449.768821:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:11408:x1875263088551168:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 228us (777us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788390449.768826:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 30 00000100:00100000:1.0:1788390449.770935:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.771439:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088551424 00000100:00100000:2.0:1788390449.771449:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088551424 00000100:00100000:2.0:1788390449.771540:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 132 00000100:00100000:2.0:1788390449.771551:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:11408:x1875263088551424:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788390449.771657:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:11408:x1875263088551424:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 107us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.771679:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 132 00000100:00100000:2.0:1788390449.775524:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.775598:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088551552 00000100:00100000:0.0:1788390449.775608:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088551552 00000100:00100000:0.0:1788390449.775656:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 133 00000100:00100000:0.0:1788390449.775663:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8806a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:11408:x1875263088551552:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390449.775683:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390449.775718:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ef8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f1a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.775791:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97eff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.775805:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.775817:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390449.775853:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390449.775867:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.775888:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97ef8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f1a expref: 69 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.775908:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97eff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f1a expref: 68 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.775918:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:0.0:1788390449.775920:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788390449.775924:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81400, rc 0) 00000100:00100000:0.0:1788390449.775985:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8806a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+68:11408:x1875263088551552:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 321us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.775992:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 133 00000100:00100000:3.0:1788390449.779142:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.779268:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088551680 00000100:00100000:2.0:1788390449.779278:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088551680 00000100:00100000:2.0:1788390449.779424:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 46 00000100:00100000:2.0:1788390449.779433:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2404:x1875263088551680:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390449.779449:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.779465:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f21 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390449.779484:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac31, blocks: 0x0 00010000:00010000:2.0:1788390449.779499:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=270s v=(0 0) 00010000:00010000:2.0:1788390449.779502:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390449.779510:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f21 expref: 10 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.779532:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f21 expref: 10 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.779541:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4a00, rc 0) 00000100:00100000:2.0:1788390449.779588:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2404:x1875263088551680:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 157us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.779593:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 46 00000100:00100000:1.0:1788390449.787671:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.787775:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088551936 00000100:00100000:3.0:1788390449.787788:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088551936 00000100:00100000:3.0:1788390449.787846:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 134 00000100:00100000:3.0:1788390449.787856:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+68:11408:x1875263088551936:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390449.787994:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+68:11408:x1875263088551936:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 139us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.788026:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 134 00000100:00100000:3.0:1788390449.790408:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.791046:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088552064 00000100:00100000:2.0:1788390449.791057:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088552064 00000100:00100000:2.0:1788390449.791131:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:2.0:1788390449.791142:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:11408:x1875263088552064:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390449.791160:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390449.791178:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f28 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.791209:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f21 expref: 11 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.791219:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390449.791223:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390449.791228:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 11 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.791264:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f21 expref: 11 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.791278:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f21 expref: 11 pid: 8408 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.791293:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1875263098040064:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390449.791401:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.795105:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1875263098040064:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390449.795148:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 11 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.795192:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:2.0:1788390449.795256:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:11408:x1875263088552064:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 4115us (4855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.795265:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:3.0:1788390449.800306:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.800559:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088552192 00000100:00100000:0.0:1788390449.800569:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088552192 00010000:00010000:0.0:1788390449.800622:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f21 expref: 11 pid: 8408 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.800668:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 73 00000100:00100000:0.0:1788390449.800678:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2404:x1875263088552192:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390449.800692:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390449.800713:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f21 expref: 11 pid: 8408 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.800728:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f21 expref: 11 pid: 8408 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.800753:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005f64240/0xe156d0713be97f06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f21 expref: 11 pid: 8408 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.800771:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390449.800775:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390449.800783:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 10 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.800793:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 10 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.800830:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 10 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.800858:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6477:1875263098040192:192.168.202.11@tcp:105: 00000100:00100000:0.0:1788390449.800931:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071300 going to sleep for 11 seconds 00000100:00100000:0.0:1788390449.803568:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6477:1875263098040192:192.168.202.11@tcp:105: 00010000:00010000:0.0:1788390449.803595:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390449.803648:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2404:x1875263088552192:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 2971us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.803659:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 73 00000100:00100000:3.0:1788390449.804904:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.806134:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088552320 00000100:00100000:0.0:1788390449.806145:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088552320 00002000:00100000:0.0:1788390449.806256:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff984fbb2ab100 x1875263088552320/t0(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:65/0 lens 504/0 e 0 to 0 dl 1788390460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390449.806312:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984fbb2ab100 with x1875263088552320 ext(0->12) 00002000:00010000:0.0:1788390449.806316:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984fbb2ab100 00000100:00100000:0.0:1788390449.806361:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:0.0:1788390449.806376:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2405:x1875263088552320:12345-192.168.202.11@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788390449.807016:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+12:2405:x1875263088552320:12345-192.168.202.11@tcp:4:lhsmtool_posix.0 Request processed in 644us (2116us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788390449.807036:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 2 00002000:00100000:0.0:1788390449.807043:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff984fbb2ab100 x1875263088552320/t4294967309(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:65/0 lens 504/448 e 0 to 0 dl 1788390460 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390449.807052:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984fbb2ab100 with x1875263088552320 ext(0->12) 00002000:00010000:0.0:1788390449.807056:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984fbb2ab100 00000100:00100000:3.0:1788390449.808504:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.808581:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088552448 00000100:00100000:2.0:1788390449.808591:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088552448 00000100:00100000:2.0:1788390449.808642:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 135 00000100:00100000:2.0:1788390449.808654:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+68:11408:x1875263088552448:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788390449.809836:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00010000:00010000:1.0:1788390449.809867:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390449.809867:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:1.0:1788390449.809879:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.809886:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390449.809887:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984e86a5ca80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788390449.809891:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984fb78d5100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984e86a5c3c0 00010000:00010000:1.0:1788390449.809892:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce200 already unused, calling callback (ffffffffc19ce4f0) 00000020:00080000:0.0:1788390449.809894:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984fb78d5400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984e8741d200 00010000:00010000:1.0:1788390449.809897:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.809904:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.809921:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff984f8c933d00) 00010000:00010000:1.0:1788390449.809923:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:0.0:1788390449.809925:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:1.0:1788390449.809935:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390449.809962:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984f83071840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788390449.809965:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e87a17000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984f83071f00 00000020:00080000:0.0:1788390449.809968:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e87a17100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984fbb12d400 00000020:00080000:0.0:1788390449.809978:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788390449.810081:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788390449.810098:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098040320:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788390449.810160:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390449.810196:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098040448:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788390449.810219:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390449.810267:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098040320 00000100:00100000:3.0:1788390449.810275:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098040320 00000020:00080000:2.0:1788390449.810298:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1788390449.810359:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098040448 00000100:00100000:3.0:1788390449.810363:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098040448 00000100:00100000:3.0:1788390449.810384:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000020:00080000:2.0:1788390449.810391:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788390449.810392:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098040320:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788390449.810412:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00002000:00080000:3.0:1788390449.810413:0:8798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00000100:00100000:2.0:1788390449.810426:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3623:x1875263098040448:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788390449.810434:0:8798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788390449.810443:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1788390449.810451:0:8798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e80 expref: 11 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.810458:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788390449.810462:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390449.810466:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390449.810469:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a98ac31, atime: 0x6a98ac31, ctime: 0x6a98ac31, blocks: 0x8 00010000:00010000:2.0:1788390449.810480:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.810490:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=270s v=(0 0) 00010000:00010000:2.0:1788390449.810494:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390449.810500:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.810501:0:8798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e80 expref: 11 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.810529:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.810532:0:8798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e80 expref: 11 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.810561:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.810563:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098040576:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390449.810575:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.810597:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788390449.810642:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.810731:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3623:x1875263098040448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 308us (510us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788390449.810737:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1788390449.810761:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390449.810767:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.810775:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390449.810779:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.810786:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.810798:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.810804:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efe379fd/0xe156d0713be97f1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.810829:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390449.810831:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390449.810833:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390449.810903:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:11408:x1875263088552448:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 Request processed in 2251us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.810911:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 135 00000100:00080000:0.0:1788390449.811112:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788390449.811497:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be97c12 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811524:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811530:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811536:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811541:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cea00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390449.811545:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811552:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811563:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff984fb7863500) 00010000:00010000:1.0:1788390449.811566:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390449.811569:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811575:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be97cba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811591:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811596:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811609:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811614:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390449.811617:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811622:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811630:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f8c933100) 00010000:00010000:1.0:1788390449.811632:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390449.811634:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811639:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be97d38 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811650:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811655:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811660:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811665:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390449.811667:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811682:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811690:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984f8c933100) 00010000:00010000:1.0:1788390449.811693:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390449.811695:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811700:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be97d5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811715:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811720:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811724:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811729:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390449.811731:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811736:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811743:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:1.0:1788390449.811745:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390449.811747:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811761:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be97e2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811773:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811779:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811785:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811789:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390449.811793:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811798:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811807:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:1.0:1788390449.811809:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788390449.811812:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.811818:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be97eea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390449.812787:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e87aa2300/2, rc 0, transno 4294967305 00000100:00100000:2.0:1788390449.812797:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098040448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788390449.813084:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098040576:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390449.813108:0:8798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.813463:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.813534:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088552576 00000100:00100000:3.0:1788390449.813781:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088552576 00010000:00010000:3.0:1788390449.813819:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e80 expref: 12 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.813908:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 74 00000100:00100000:3.0:1788390449.813918:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+12:2405:x1875263088552576:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390449.813931:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390449.813937:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e80 expref: 12 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.813954:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e80 expref: 12 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.813975:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8f51c04/0xe156d0713be97cc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e80 expref: 12 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.814007:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390449.814012:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390449.814028:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.814038:0:10369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.814070:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390449.814097:0:8798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.814107:0:8798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.814123:0:8798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.814129:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2405:x1875263088552576:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 213us (666us total) trans 0 rc 0/0 00010000:00010000:1.0:1788390449.814131:0:8798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.814137:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 74 00010000:00010000:1.0:1788390449.814151:0:8798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788390449.814310:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3623:x1875263098040320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3919us (4151us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788390449.814335:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1788390449.814355:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390449.814361:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.814369:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390449.814374:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.814382:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.814394:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.814400:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006814e59b/0xe156d0713be97f14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.814424:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390449.814425:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390449.814427:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788390449.814479:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e87af4a80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788390449.814500:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098040320:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788390449.814936:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.815007:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088552704 00000100:00100000:2.0:1788390449.815012:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088552704 00000100:00100000:2.0:1788390449.815098:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00100000:2.0:1788390449.815107:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2404:x1875263088552704:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788390449.816563:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788390449.816573:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1788390449.816837:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088552704:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 Request processed in 1728us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390449.816848:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00100000:2.0:1788390449.818534:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.818676:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088552960 00000100:00100000:3.0:1788390449.818686:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088552960 00000100:00100000:3.0:1788390449.818748:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 136 00000100:00100000:3.0:1788390449.818758:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:11408:x1875263088552960:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390449.818812:0:8996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390449.818840:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be97eff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f1a expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.818860:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:3.0:1788390449.818865:0:8996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390449.818892:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.818904:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.818927:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390449.819072:0:8996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064f6d328 reply state 000000002beb6421 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.819093:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.819101:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:3.0:1788390449.819103:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390449.819106:0:8996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390449.819200:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:11408:x1875263088552960:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 442us (671us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788390449.819208:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 136 00000100:00100000:1.0:1788390449.821470:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.821563:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088553088 00000100:00100000:0.0:1788390449.821572:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088553088 00000100:00100000:0.0:1788390449.821627:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:0.0:1788390449.821637:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088553088:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788390449.821783:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788390449.821788:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788390449 00002000:00010000:0.0:1788390449.821790:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788390449 00002000:00010000:0.0:1788390449.821793:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788390449 -> 1788390449 00002000:00010000:0.0:1788390449.821795:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788390449.821870:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088553088:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 234us (409us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788390449.821878:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:0.0:1788390449.824247:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.824377:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088553344 00000100:00100000:3.0:1788390449.824387:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088553344 00000100:00100000:2.0:1788390449.825940:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 137 00000100:00100000:2.0:1788390449.825953:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:11408:x1875263088553344:12345-192.168.202.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788390449.826037:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.826073:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f0c expref: 17 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.826082:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.826122:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f0c expref: 17 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.826136:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f0c expref: 17 pid: 12122 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390449.826150:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88166a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098040704:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390449.826238:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954000 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.828298:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.828319:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88166a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098040704:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390449.828367:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.828434:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088553472 00000100:00100000:1.0:1788390449.828441:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088553472 00010000:00010000:1.0:1788390449.828477:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f0c expref: 18 pid: 12122 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.828514:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 75 00000100:00100000:1.0:1788390449.828524:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88166d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:2405:x1875263088553472:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390449.828537:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390449.828544:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f0c expref: 18 pid: 12122 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.828556:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f0c expref: 18 pid: 12122 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.828579:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be97ee3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f0c expref: 18 pid: 12122 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.828593:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:1.0:1788390449.828596:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.828615:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.828620:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.828639:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390449.828676:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88166d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:2405:x1875263088553472:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 152us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390449.828684:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 75 00010000:00010000:0.0:1788390449.828687:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.828698:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.828734:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.828742:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.828750:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.828757:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.828762:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.828776:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.828791:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:0.0:1788390449.828800:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788390449.828804:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.828810:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f29 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.828856:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:11408:x1875263088553344:12345-192.168.202.11@tcp:55:lhsmtool_posix.0 Request processed in 2906us (4614us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788390449.828865:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 137 00000100:00100000:2.0:1788390449.830714:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.830922:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088553600 00000100:00100000:0.0:1788390449.830932:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088553600 00000100:00100000:0.0:1788390449.831017:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:0.0:1788390449.831036:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088553600:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788390449.831076:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.831094:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.831102:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390449.831106:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390449.831111:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.831142:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 7 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.831173:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 7 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.831187:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1875263098040832:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390449.831260:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071000 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.832656:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.832756:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088553728 00000100:00100000:1.0:1788390449.832763:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088553728 00010000:00010000:1.0:1788390449.832795:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 8 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.832836:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 76 00000100:00100000:1.0:1788390449.832845:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088553728:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390449.832856:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390449.832877:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 8 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.832892:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 8 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.832913:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390449.832916:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390449.832920:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.832932:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be97f0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f28 expref: 8 pid: 8409 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.832938:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.832958:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1875263098040832:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390449.832977:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390449.832980:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.832990:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.832995:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.833011:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.833017:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.833037:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088553728:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 191us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390449.833050:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 76 00010000:00010000:0.0:1788390449.833060:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.833068:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390449.833072:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.833081:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.833106:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.833113:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000942793d7/0xe156d0713be97f30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.833172:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088553600:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 Request processed in 2137us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.833179:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:2.0:1788390449.834736:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.834776:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088553984 00000100:00100000:0.0:1788390449.834784:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088553984 00000100:00100000:0.0:1788390449.834837:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 138 00000100:00100000:0.0:1788390449.834848:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:11408:x1875263088553984:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788390449.834937:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.834966:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ed4 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.834975:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.835032:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ed4 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.835049:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ed4 expref: 16 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.835063:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098040960:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390449.835140:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390449.839893:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.839987:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098040960:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390449.840014:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.840086:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088554112 00000100:00100000:3.0:1788390449.840093:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088554112 00010000:00010000:3.0:1788390449.840132:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ed4 expref: 17 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.840172:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 77 00000100:00100000:3.0:1788390449.840183:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:2404:x1875263088554112:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390449.840199:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390449.840206:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ed4 expref: 17 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.840232:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ed4 expref: 17 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.840252:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97e26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ed4 expref: 17 pid: 6494 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.840266:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:3.0:1788390449.840272:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef7 expref: 16 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.840282:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.840289:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.840296:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.840343:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390449.840372:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.840379:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.840399:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:2404:x1875263088554112:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 217us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.840406:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 77 00010000:00010000:0.0:1788390449.840541:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.840553:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f13 expref: 16 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.840572:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.840599:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f13 expref: 16 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.840611:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f13 expref: 16 pid: 8996 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.840639:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098041088:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390449.840702:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390449.843216:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098041088:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390449.843241:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.843633:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390449.843831:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088554240 00000100:00100000:3.0:1788390449.843839:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088554240 00010000:00010000:3.0:1788390449.843874:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f13 expref: 17 pid: 8996 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390449.843933:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 78 00000100:00100000:3.0:1788390449.843943:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:2404:x1875263088554240:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390449.843958:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390449.843965:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f13 expref: 17 pid: 8996 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.843977:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f13 expref: 17 pid: 8996 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.843999:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be97ef1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f13 expref: 17 pid: 8996 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.844016:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:3.0:1788390449.844032:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.844042:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.844049:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390449.844077:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390449.844139:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:2404:x1875263088554240:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 197us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.844146:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 78 00010000:00010000:0.0:1788390449.844247:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.844256:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390449.844406:0:12122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788390449.844518:0:12122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788390449.844553:0:12122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788390449.844631:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12122:1875263098041216:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788390449.844707:0:12122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390449.844735:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f830716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390449.845376:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098041216 00000100:00100000:3.0:1788390449.845390:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098041216 00000100:00100000:3.0:1788390449.845439:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788390449.845449:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12122:x1875263098041216:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788390449.845538:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12122:x1875263098041216:12345-0@lo:1000:mdt00_004.0 Request processed in 91us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.845545:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788390449.845676:0:12122:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788390449.845682:0:12122:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1788390449.845701:0:12122:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984e87af4a80, transno 4294967310 00000100:00100000:0.0:1788390449.845760:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12122:1875263098041216:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788390449.845868:0:12122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788390449.845914:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12122:1875263098041344:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788390449.845954:0:12122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390449.845978:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071000 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.846013:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098041344 00000100:00100000:2.0:1788390449.846031:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098041344 00000100:00100000:2.0:1788390449.846074:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788390449.846083:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12122:x1875263098041344:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788390449.846188:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12122:x1875263098041344:12345-0@lo:1000:mdt00_004.0 Request processed in 100us (229us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788390449.846199:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788390449.846214:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12122:1875263098041344:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788390449.846247:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846255:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846260:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846265:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.846269:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846277:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846292:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:0.0:1788390449.846295:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390449.846299:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846317:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f3e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846366:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846371:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846374:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846377:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.846379:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846390:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846399:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.846402:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390449.846408:0:12122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef7 expref: 19 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846419:0:12122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef7 expref: 19 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846427:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef7 expref: 19 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.846466:0:12122:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef7 expref: 19 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.846477:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098041472:192.168.202.11@tcp:105: 00000100:00100000:0.0:1788390449.846533:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071000 going to sleep for 11 seconds 00000100:00100000:2.0:1788390449.848275:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.848721:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088554368 00000100:00100000:1.0:1788390449.848730:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088554368 00000100:00100000:0.0:1788390449.848899:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098041472:192.168.202.11@tcp:105: 00010000:00010000:0.0:1788390449.848925:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.848934:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97e81 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.848963:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.848974:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.848984:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.848993:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849000:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849007:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.849015:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:1.0:1788390449.849037:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:11407:x1875263088554368:12345-192.168.202.11@tcp:49:lfs.0 00010000:00010000:0.0:1788390449.849044:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.849050:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849058:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849072:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.849074:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.849078:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849082:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849092:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849097:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849104:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849109:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.849113:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849120:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849145:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.849149:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390449.849152:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.849160:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.849167:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:11407:x1875263088554368:12345-192.168.202.11@tcp:49:lfs.0 Request processed in 134us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390449.849176:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:0.0:1788390449.849284:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:11408:x1875263088553984:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 14438us (14552us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788390449.849292:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 138 00000020:00080000:0.0:1788390449.849295:0:12122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788390449.849493:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390449.849498:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390449.851063:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788390449.851079:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788390449.851861:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.851898:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390449.851992:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088554624 00000100:00100000:2.0:1788390449.852000:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088554624 00000100:00100000:3.0:1788390449.852056:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088554880 00000100:00100000:3.0:1788390449.852062:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088554880 00000100:00100000:2.0:1788390449.852063:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 32 00000100:00100000:2.0:1788390449.852077:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb604c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:11408:x1875263088554624:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788390449.852107:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 139 00000100:00100000:3.0:1788390449.852116:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:11407:x1875263088554880:12345-192.168.202.11@tcp:58:lfs.0 00000040:00080000:3.0:1788390449.852238:0:8996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788390449.852305:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:11407:x1875263088554880:12345-192.168.202.11@tcp:58:lfs.0 Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390449.852313:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 139 00000004:00080000:2.0:1788390449.852351:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788390449.852385:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788390449.852419:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.852434:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.852445:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.852453:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.852459:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.852466:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390449.852488:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788390449.852536:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb604c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:11408:x1875263088554624:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 462us (679us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788390449.852559:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 32 00000020:00080000:2.0:1788390449.852562:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390449.852654:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390449.852660:0:13157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.852668:0:13157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735000 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390449.852673:0:13157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.852691:0:13157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.852704:0:13157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:1.0:1788390449.852707:0:13157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788390449.852711:0:13157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.852717:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97f4c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.852729:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390449.852731:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390449.852733:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390449.874653:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.874722:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088555008 00000100:00100000:0.0:1788390449.874733:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088555008 00000100:00100000:0.0:1788390449.874795:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 140 00000100:00100000:0.0:1788390449.874819:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:11410:x1875263088555008:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390449.874845:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390449.874867:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f2f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.874931:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.874942:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.874950:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.874974:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.874978:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.874982:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.875061:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.875069:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef0 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.875074:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.875120:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef0 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.875133:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef0 expref: 22 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390449.875147:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098041600:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390449.875232:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390449.877908:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098041600:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390449.877938:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.878402:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390449.878437:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088555264 00000100:00100000:0.0:1788390449.878445:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088555264 00000100:00100000:0.0:1788390449.878486:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:0.0:1788390449.878493:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:6165:x1875263088555264:12345-192.168.202.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788390449.878754:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:6165:x1875263088555264:12345-192.168.202.11@tcp:35:ldlm_bl.0 Request processed in 260us (352us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788390449.878762:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:3.0:1788390449.882495:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390449.882560:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088555392 00000100:00100000:1.0:1788390449.882571:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088555392 00010000:00010000:1.0:1788390449.882609:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef0 expref: 24 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.882643:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 79 00000100:00100000:1.0:1788390449.882650:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:2405:x1875263088555392:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390449.882661:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390449.882666:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef0 expref: 24 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.882678:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef0 expref: 24 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.882708:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be97e73 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef0 expref: 24 pid: 6493 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.882722:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:1.0:1788390449.882726:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.882732:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.882737:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390449.882758:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390449.882788:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882796:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390449.882846:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788390449.882850:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390449.882870:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882883:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882892:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882899:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882905:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882922:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.882926:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882934:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390449.882942:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:2405:x1875263088555392:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 291us (456us total) trans 0 rc 0/0 00010000:00010000:0.0:1788390449.882944:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:0.0:1788390449.882947:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788390449.882950:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 79 00010000:00010000:0.0:1788390449.882950:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882984:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be97f5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882994:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.882998:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.883002:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.883005:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390449.883006:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.883010:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.883037:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff984fbae78400) 00010000:00010000:0.0:1788390449.883040:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390449.883043:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.883049:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.883085:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f2f expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.883099:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f2f expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390449.883106:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390449.883109:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390449.883111:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81e00, rc 0) 00000100:00100000:0.0:1788390449.883138:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:11410:x1875263088555008:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 8324us (8493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390449.883145:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 140 00010000:00010000:0.0:1788390450.321491:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390450.344191:0:14278:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390450.344199:0:14278:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390450.344278:0:14278:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788390450.344283:0:14278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390450.452045:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390450.452087:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390450.452120:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390450.452143:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390450.452166:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390450.452190:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088555776 00000100:00100000:0.0:1788390450.452207:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088555776 00000100:00100000:0.0:1788390450.452256:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 61 00000100:00100000:0.0:1788390450.452266:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2404:x1875263088555776:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390450.452352:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2404:x1875263088555776:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 86us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390450.452360:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 61 00000100:00100000:0.0:1788390450.452385:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088555648 00000100:00100000:0.0:1788390450.452388:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088555648 00000100:00100000:0.0:1788390450.452418:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088555904 00000100:00100000:0.0:1788390450.452421:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088555904 00000100:00100000:0.0:1788390450.452438:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088556032 00000100:00100000:0.0:1788390450.452440:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088556032 00000100:00100000:0.0:1788390450.452456:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 206 00000100:00100000:0.0:1788390450.452461:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088555648:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390450.452488:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088555648:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390450.452494:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 206 00000100:00100000:0.0:1788390450.452507:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 207 00000100:00100000:1.0:1788390450.452606:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 208 00000100:00100000:1.0:1788390450.452615:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088556032:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390450.452642:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088556032:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390450.452649:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 208 00000100:00100000:0.0:1788390450.452687:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2405:x1875263088555904:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390450.452713:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2405:x1875263088555904:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 201us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390450.452720:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 207 00000100:00080000:0.0:1788390450.452736:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390450.452739:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390450.453409:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088555520 00000100:00100000:3.0:1788390450.453415:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088555520 00000100:00100000:3.0:1788390450.453484:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 363 00000100:00100000:3.0:1788390450.453492:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2404:x1875263088555520:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390450.454635:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2404:x1875263088555520:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 1137us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390450.454645:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 363 00000040:00080000:0.0:1788390450.514884:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788390450.770267:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098041728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390450.770512:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390450.770750:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098041728 00000100:00100000:0.0:1788390450.770760:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098041728 00000100:00100000:0.0:1788390450.770848:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788390450.770872:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098041728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788390450.770903:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788390450.771583:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098041728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 725us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390450.771593:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788390450.772768:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098041728:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788390450.774266:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788390450.774282:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:2.0:1788390450.897519:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390450.897529:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390450.897558:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788390450.897567:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788390450.897695:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098041856:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390450.897851:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e87954cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390450.907910:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390450.908183:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088556160 00000100:00100000:1.0:1788390450.908209:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088556160 00000100:00100000:1.0:1788390450.908273:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 141 00000100:00100000:1.0:1788390450.908283:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:11422:x1875263088556160:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788390450.908342:0:12122:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788390450.908377:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098041856:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788390450.908459:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:11422:x1875263088556160:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 177us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390450.908467:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 141 00000100:00100000:0.0:1788390450.917416:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390450.917540:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088556416 00000100:00100000:2.0:1788390450.917552:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088556416 00000100:00100000:2.0:1788390450.917617:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 142 00000100:00100000:2.0:1788390450.917629:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:11422:x1875263088556416:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390450.917652:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390450.917677:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97f6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f36 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390450.917789:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97f76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390450.917804:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390450.917834:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390450.917846:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788390450.917952:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97f6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f36 expref: 25 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390450.917972:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97f76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f36 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390450.917982:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390450.917985:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390450.917989:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf734e00, rc 0) 00000100:00100000:2.0:1788390450.918180:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:11422:x1875263088556416:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 553us (774us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788390450.918188:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 142 00000100:00100000:3.0:1788390450.921850:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390450.921957:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088556672 00000100:00100000:0.0:1788390450.921967:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088556672 00000100:00100000:0.0:1788390450.922043:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 143 00000100:00100000:0.0:1788390450.922054:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:11422:x1875263088556672:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788390450.922132:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390450.922152:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390450.922165:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390450.922313:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390450.922363:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390450.922371:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390450.922394:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390450.922399:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390450.922407:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390450.922420:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390450.922424:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390450.922430:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390450.922435:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be97f84 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390450.922556:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:11422:x1875263088556672:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 504us (714us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788390450.922564:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 143 00000040:00080000:2.0:1788390450.922972:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390450.922978:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390450.923582:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788390450.923591:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390450.926554:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390450.926696:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088556800 00000100:00100000:2.0:1788390450.926706:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088556800 00000100:00100000:2.0:1788390450.926762:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:2.0:1788390450.926773:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:2406:x1875263088556800:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390450.926789:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390450.926814:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97f76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f36 expref: 25 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390450.926851:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390450.926858:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390450.926916:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:2406:x1875263088556800:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 145us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390450.926923:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:3.0:1788390450.931635:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390450.931993:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088557056 00000100:00100000:2.0:1788390450.932003:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088557056 00000100:00100000:2.0:1788390450.932177:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 34 00000100:00100000:2.0:1788390450.932189:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:11422:x1875263088557056:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788390450.932432:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:11422:x1875263088557056:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 245us (808us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788390450.932441:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 34 00010000:00010000:2.0:1788390451.345488:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390451.854744:0:14329:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390451.854752:0:14329:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390451.854781:0:14329:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788390451.854786:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788390451.993956:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390451.994036:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088557312 00000100:00100000:0.0:1788390451.994045:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088557312 00000100:00100000:0.0:1788390451.994129:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 144 00000100:00100000:0.0:1788390451.994141:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:11442:x1875263088557312:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390451.994174:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788390451.994192:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788390451.994195:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390451.994439:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f92 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390451.994460:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390451.994470:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390451.994480:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788390451.994680:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81000/0xe156d0713be97f8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f3d expref: 28 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390451.994692:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f3d expref: 27 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390451.994698:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:0.0:1788390451.994700:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788390451.994703:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80400, rc 0) 00000100:00100000:0.0:1788390451.994752:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:11442:x1875263088557312:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 614us (803us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788390451.994759:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 144 00000100:00100000:1.0:1788390451.999254:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390451.999372:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088557440 00000100:00100000:2.0:1788390451.999383:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088557440 00000100:00100000:2.0:1788390451.999440:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 145 00000100:00100000:2.0:1788390451.999452:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:11442:x1875263088557440:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:2.0:1788390451.999585:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.999602:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.999624:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.999656:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.999663:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.999669:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.999675:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390451.999678:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.999685:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.999696:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:2.0:1788390451.999700:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390451.999705:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390451.999711:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390451.999786:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:11442:x1875263088557440:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 336us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390451.999795:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 145 00000100:00100000:2.0:1788390452.048093:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390452.048262:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088557568 00000100:00100000:0.0:1788390452.048271:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088557568 00000100:00100000:0.0:1788390452.048377:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:0.0:1788390452.048389:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2406:x1875263088557568:12345-192.168.202.11@tcp:101:cat.0 00010000:00010000:0.0:1788390452.048406:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390452.048429:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e20e3ca8/0xe156d0713be97fa7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f44 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390452.048466:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a98ac31, atime: 0x6a98ac31, ctime: 0x6a98ac31, blocks: 0x8 00010000:00010000:0.0:1788390452.048487:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1788390452.048491:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390452.048651:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e20e3ca8/0xe156d0713be97fa7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f44 expref: 7 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390452.048672:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e20e3ca8/0xe156d0713be97fa7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f44 expref: 7 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390452.048686:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81000, rc 0) 00000100:00100000:0.0:1788390452.048750:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2406:x1875263088557568:12345-192.168.202.11@tcp:101:cat.0 Request processed in 363us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390452.048757:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00080000:1.0:1788390452.048842:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390452.052785:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390452.053076:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088557696 00000100:00100000:0.0:1788390452.053085:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088557696 00002000:00100000:0.0:1788390452.053136:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff984fb7871880 x1875263088557696/t0(0) o3->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:68/0 lens 488/0 e 0 to 0 dl 1788390463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390452.053147:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984fb7871880 with x1875263088557696 ext(0->4095) 00002000:00010000:0.0:1788390452.053152:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984fb7871880 00000100:00100000:0.0:1788390452.053189:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:0.0:1788390452.053199:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088557696:12345-192.168.202.11@tcp:3:cat.0 00000100:00100000:2.0:1788390452.053536:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088557696:12345-192.168.202.11@tcp:3:cat.0 Request processed in 337us (756us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788390452.053545:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 3 00002000:00100000:2.0:1788390452.053553:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff984fb7871880 x1875263088557696/t0(0) o3->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:68/0 lens 488/4536 e 0 to 0 dl 1788390463 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788390452.053562:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984fb7871880 with x1875263088557696 ext(0->4095) 00002000:00010000:2.0:1788390452.053566:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984fb7871880 00010000:00010000:1.0:1788390452.370960:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390452.817536:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390452.817563:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098041984:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788390452.817621:0:8794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 273375298436ns, next at 274375294762ns, rc = 0 00000100:00100000:2.0:1788390452.817646:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390452.817652:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098042240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390452.817706:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390452.817712:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f89f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098042112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788390452.817758:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390452.817768:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098041984 00000100:00100000:3.0:1788390452.817789:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098041984 00000100:00100000:2.0:1788390452.817799:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098042112 00000100:00100000:2.0:1788390452.817805:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098042112 00000100:00100000:3.0:1788390452.817859:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098042240 00000100:00100000:2.0:1788390452.817860:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788390452.817865:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098042240 00000100:00100000:2.0:1788390452.817873:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098042112:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390452.817889:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788390452.817898:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098041984:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:2.0:1788390452.817923:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:3.0:1788390452.817924:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788390452.817980:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098042112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390452.817983:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098041984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390452.818008:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788390452.818031:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788390452.818053:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788390452.818062:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f89f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098042112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788390452.818067:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263098042240:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390452.818082:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098041984:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788390452.818083:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788390452.818127:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263098042240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (420us total) trans 0 rc 0/0 00000100:00080000:2.0:1788390452.818148:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390452.818518:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098042240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390452.818764:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788390453.333692:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390453.333718:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098042368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390453.333805:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390453.334191:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098042368 00000100:00100000:3.0:1788390453.334200:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098042368 00000100:00100000:3.0:1788390453.334264:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788390453.334274:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098042368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390453.334307:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390453.334393:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098042368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390453.334401:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788390453.334614:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390453.334747:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390453.334761:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098042496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788390453.334807:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390453.334941:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098042496 00000100:00100000:2.0:1788390453.334947:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098042496 00000100:00100000:2.0:1788390453.335015:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788390453.335022:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098042496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788390453.335035:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390453.335070:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098042496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390453.335076:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788390453.335167:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788390453.335174:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1788390453.335196:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984f89f33480, transno 4294967302 00000004:00080000:1.0:1788390453.335216:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1788390453.335229:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984e87aa2300, transno 4294967305 00000100:00100000:1.0:1788390453.335242:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098042368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390453.335400:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098042880:0@lo:400:kworker.0 00000100:00100000:1.0:1788390453.335440:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390453.335459:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098043392:0@lo:400:kworker.0 00000100:00100000:2.0:1788390453.335875:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098042880 00000100:00100000:2.0:1788390453.335881:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098042880 00000100:00100000:2.0:1788390453.335914:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788390453.335922:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098042880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390453.335964:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098042880:12345-0@lo:400:kworker.0 Request processed in 43us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390453.335972:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788390453.336010:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098042752:0@lo:400:kworker.0 00000100:00100000:1.0:1788390453.336139:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390453.336192:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098042880:0@lo:400:kworker.0 00000100:00080000:0.0:1788390453.336678:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390453.336695:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098042624:0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.336730:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390453.336763:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098043136:0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.336802:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390453.336834:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098042496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788390453.336846:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788390453.336851:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098043008:0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.336870:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390453.336883:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098043520:0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.336898:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390453.336921:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098043392 00000100:00100000:0.0:1788390453.336925:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098043392 00000100:00100000:0.0:1788390453.336960:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098043136 00000100:00100000:0.0:1788390453.336962:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098043136 00000100:00100000:0.0:1788390453.336981:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098043008 00000100:00100000:0.0:1788390453.336983:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098043008 00000100:00100000:0.0:1788390453.337005:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098043520 00000100:00100000:0.0:1788390453.337008:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098043520 00000100:00100000:0.0:1788390453.337020:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788390453.337026:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098043392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.337061:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098043392:12345-0@lo:400:kworker.0 Request processed in 35us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390453.337067:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788390453.337083:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788390453.337088:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098043136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.337110:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098043136:12345-0@lo:400:kworker.0 Request processed in 23us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390453.337115:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788390453.337124:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788390453.337129:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098043008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.337148:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098043008:12345-0@lo:400:kworker.0 Request processed in 19us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390453.337153:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788390453.337161:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788390453.337166:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098043520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.337184:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098043520:12345-0@lo:400:kworker.0 Request processed in 18us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390453.337189:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1788390453.337208:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788390453.337210:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390453.337224:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098043008:0@lo:400:kworker.0 00010000:00080000:0.0:1788390453.337241:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88242680 x1875263098043520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390453.337251:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098043520:0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.337259:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098043136:0@lo:400:kworker.0 00000100:00100000:2.0:1788390453.337661:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390453.337691:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098043264:0@lo:400:kworker.0 00000100:00100000:2.0:1788390453.337716:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390453.337798:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098042624 00000100:00100000:1.0:1788390453.337803:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098042624 00000100:00100000:1.0:1788390453.337839:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788390453.337845:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098042624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390453.337877:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3625:x1875263098042624:12345-0@lo:400:kworker.0 Request processed in 33us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390453.337883:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788390453.337919:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098043392:0@lo:400:kworker.0 00000100:00100000:3.0:1788390453.338048:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098042752 00000100:00100000:3.0:1788390453.338052:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098042752 00000100:00100000:3.0:1788390453.338086:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098043264 00000100:00100000:3.0:1788390453.338089:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098043264 00000100:00100000:3.0:1788390453.338114:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788390453.338121:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098042752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390453.338152:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb76e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098042752:12345-0@lo:400:kworker.0 Request processed in 32us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390453.338157:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788390453.338167:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788390453.338179:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f89f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098043264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390453.338202:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f89f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098043264:12345-0@lo:400:kworker.0 Request processed in 23us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390453.338207:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:2.0:1788390453.338249:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788390453.338268:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fb7870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098042752:0@lo:400:kworker.0 00010000:00080000:2.0:1788390453.338278:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb151c00 x1875263098043264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390453.338287:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098043264:0@lo:400:kworker.0 00000100:00100000:0.0:1788390453.338480:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098042624:0@lo:400:kworker.0 00010000:00010000:1.0:1788390453.393709:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390454.417557:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390454.847308:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390454.847442:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088557824 00000100:00100000:2.0:1788390454.847453:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088557824 00000100:00100000:2.0:1788390454.847531:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 146 00000100:00100000:2.0:1788390454.847545:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:11088:x1875263088557824:12345-192.168.202.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788390454.847658:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:11088:x1875263088557824:12345-192.168.202.11@tcp:60:lhsmtool_posix.0 Request processed in 116us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390454.847667:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 146 00000100:00080000:0.0:1788390454.847751:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390454.849627:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390454.849785:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088557952 00000100:00100000:0.0:1788390454.849795:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088557952 00000100:00100000:0.0:1788390454.849927:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 147 00000100:00100000:0.0:1788390454.849939:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:11088:x1875263088557952:12345-192.168.202.11@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788390454.850054:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:11088:x1875263088557952:12345-192.168.202.11@tcp:60:lhsmtool_posix.0 Request processed in 116us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390454.850062:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 147 00000100:00080000:2.0:1788390454.850205:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390454.855122:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390454.856371:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088558208 00000100:00100000:0.0:1788390454.856383:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088558208 00000100:00100000:0.0:1788390454.856531:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:0.0:1788390454.856542:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:11088:x1875263088558208:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390454.857930:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+28:11088:x1875263088558208:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 1383us (2811us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788390454.857942:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 35 00000001:00080000:3.0:1788390454.860807:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000004:00080000:3.0:1788390454.860832:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788390454.860869:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984f830710c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788390454.860874:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e87a17c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984fa248b900 00000020:00080000:3.0:1788390454.860878:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e87a17500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984fbb12c800 00000020:00080000:3.0:1788390454.860899:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788390454.860948:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788390454.861031:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788390454.861043:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390454.861063:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098043648:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788390454.861077:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390454.861089:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390454.861128:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390454.861169:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390454.861176:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cec00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390454.861181:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390454.861188:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390454.861208:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff984f8c933e00) 00010000:00010000:0.0:1788390454.861215:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390454.861220:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390454.861227:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be97f22 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390454.861237:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098043648 00000100:00100000:2.0:1788390454.861244:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098043648 00000100:00080000:0.0:1788390454.861285:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390454.861297:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788390454.861308:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098043648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788390454.861463:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788390454.861468:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788390449 -> 1788390449 00002000:00010000:2.0:1788390454.861470:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788390449 -> 1788390449 00002000:00010000:2.0:1788390454.861472:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788390449 -> 1788390449 00002000:00010000:2.0:1788390454.861473:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788390454.861511:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3624:x1875263098043648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (384us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788390454.861518:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1788390454.861603:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e88243800/2, rc 0, transno 4294967313 00000100:00100000:1.0:1788390454.861614:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098043648:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1788390454.870937:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1788390454.870957:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:3.0:1788390455.042411:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390455.042587:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088558336 00000100:00100000:1.0:1788390455.042600:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088558336 00000100:00100000:1.0:1788390455.042691:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 148 00000100:00100000:1.0:1788390455.042703:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:11900:x1875263088558336:12345-192.168.202.11@tcp:101:lsof.0 00010000:00010000:1.0:1788390455.042728:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390455.042753:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97fae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f4b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390455.042833:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390455.042850:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390455.042883:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390455.042944:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788390455.042949:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390455.043008:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390455.043038:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be97fae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f4b expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390455.043059:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f4b expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390455.043070:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:1.0:1788390455.043073:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390455.043078:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cf800, rc 0) 00000100:00100000:1.0:1788390455.043151:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:11900:x1875263088558336:12345-192.168.202.11@tcp:101:lsof.0 Request processed in 451us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390455.043158:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 148 00000100:00080000:0.0:1788390455.043239:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390455.441770:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390455.579019:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390455.579074:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390455.579113:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390455.579137:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088558464 00000100:00100000:3.0:1788390455.579147:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390455.579153:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088558464 00000100:00100000:3.0:1788390455.579180:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390455.579208:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390455.579229:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 365 00000100:00100000:2.0:1788390455.579245:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2404:x1875263088558464:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390455.579252:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390455.579275:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088558720 00000100:00100000:1.0:1788390455.579281:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088558720 00000100:00100000:1.0:1788390455.579354:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088559232 00000100:00100000:1.0:1788390455.579358:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088559232 00000100:00100000:1.0:1788390455.579386:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088558592 00000100:00100000:1.0:1788390455.579389:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088558592 00000100:00100000:2.0:1788390455.579395:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2404:x1875263088558464:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 152us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390455.579405:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088559104 00000100:00100000:2.0:1788390455.579406:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 365 00000100:00100000:1.0:1788390455.579409:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088559104 00000100:00100000:2.0:1788390455.579497:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 215 00000100:00100000:2.0:1788390455.579506:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088558720:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390455.579546:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088558720:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 39us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390455.579552:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 216 00000100:00100000:2.0:1788390455.579566:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 215 00000100:00100000:1.0:1788390455.579570:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088559232:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390455.579591:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 217 00000100:00100000:2.0:1788390455.579601:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+13:2404:x1875263088558592:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390455.579608:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088559232:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 39us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390455.579615:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 216 00000100:00100000:1.0:1788390455.579631:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 218 00000100:00100000:1.0:1788390455.579638:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2404:x1875263088559104:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390455.579646:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+13:2404:x1875263088558592:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 46us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390455.579654:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 217 00000100:00100000:1.0:1788390455.579667:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2404:x1875263088559104:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390455.579675:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 218 00000100:00080000:1.0:1788390455.579697:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390455.585753:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088558976 00000100:00100000:0.0:1788390455.585776:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088558976 00000100:00100000:3.0:1788390455.586644:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088558848 00000100:00100000:3.0:1788390455.586653:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088558848 00000100:00100000:3.0:1788390455.586754:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 62 00000100:00100000:3.0:1788390455.586769:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088558848:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390455.586923:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 63 00000100:00100000:0.0:1788390455.586932:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088558976:12345-192.168.202.11@tcp:400:kworker.0 00000100:00080000:1.0:1788390455.587049:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390455.587055:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390455.589111:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2404:x1875263088558848:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 2323us (9880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390455.589161:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 62 00000100:00100000:0.0:1788390455.590248:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2404:x1875263088558976:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 3310us (11128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390455.590261:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 63 00000100:00100000:2.0:1788390455.889909:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098043776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390455.890029:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390455.890764:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098043776 00000100:00100000:3.0:1788390455.890833:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098043776 00000100:00100000:3.0:1788390455.890944:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788390455.890956:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098043776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788390455.891016:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788390455.891136:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098043776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 182us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390455.891144:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788390455.891245:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098043776:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788390456.467022:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788390456.576565:0:14526:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:07:35 (1788390455) 00000100:00100000:3.0:1788390457.232409:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390457.233052:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088559488 00000100:00100000:2.0:1788390457.233067:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088559488 00000100:00100000:2.0:1788390457.233224:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 149 00000100:00100000:2.0:1788390457.233236:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+13:12168:x1875263088559488:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390457.233265:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390457.233294:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fbc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f52 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.233445:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.233474:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.233510:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.233685:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.233710:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.233724:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.233876:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be97fd1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.233885:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be97fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.233892:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be97fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390457.233903:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788390457.234012:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234020:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234026:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234032:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390457.234048:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234056:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234069:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984fba803200) 00010000:00010000:2.0:1788390457.234072:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390457.234076:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234082:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be97fc3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234098:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234104:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234109:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234114:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390457.234117:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234123:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234130:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff984f8379be00) 00010000:00010000:2.0:1788390457.234132:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390457.234141:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234147:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be97fca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234494:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734e00/0xe156d0713be97fbc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f52 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234511:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be97fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f52 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390457.234518:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:2.0:1788390457.234521:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390457.234523:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1a00, rc 0) 00000100:00080000:1.0:1788390457.234571:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390457.234592:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:12168:x1875263088559488:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 1356us (2194us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788390457.234599:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 149 00000100:00100000:2.0:1788390457.241837:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390457.241960:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390457.242122:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088559744 00000100:00100000:3.0:1788390457.242132:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088559744 00000100:00100000:3.0:1788390457.242198:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:3.0:1788390457.242207:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:2406:x1875263088559744:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390457.242221:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390457.242245:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be97fd1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f52 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390457.242263:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:3.0:1788390457.242268:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390457.242350:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:2406:x1875263088559744:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 144us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390457.242358:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:1.0:1788390457.243124:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088559616 00000100:00100000:1.0:1788390457.243133:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088559616 00000100:00100000:1.0:1788390457.243182:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 150 00000100:00100000:1.0:1788390457.243191:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:12168:x1875263088559616:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788390457.243275:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:12168:x1875263088559616:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 Request processed in 85us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390457.243282:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 150 00000100:00100000:2.0:1788390457.246281:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390457.247419:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088559872 00000100:00100000:1.0:1788390457.247428:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088559872 00000100:00100000:1.0:1788390457.247503:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 151 00000100:00100000:1.0:1788390457.247514:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:12168:x1875263088559872:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788390457.247627:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:12168:x1875263088559872:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 Request processed in 115us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390457.247633:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 151 00000100:00080000:0.0:1788390457.247735:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788390457.489494:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390457.682120:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788390457.939314:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390457.939367:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098043904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390457.939534:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390457.939936:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098043904 00000100:00100000:3.0:1788390457.939954:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098043904 00000100:00100000:1.0:1788390457.940111:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098044032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390457.940141:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390457.940169:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390457.940175:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098044160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390457.940199:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390457.940226:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098044032 00000100:00100000:1.0:1788390457.940230:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098044032 00000100:00100000:3.0:1788390457.940302:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788390457.940338:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098043904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390457.940367:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788390457.940416:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098043904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390457.940424:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788390457.940472:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788390457.940477:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000004:00080000:3.0:1788390457.940494:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984e88243800, transno 4294967313 00000100:00100000:3.0:1788390457.940512:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098043904:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390457.942769:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390457.943387:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098044160 00000100:00100000:0.0:1788390457.943397:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098044160 00000100:00100000:0.0:1788390457.943462:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788390457.943473:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098044160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788390457.943509:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788390457.943593:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098044160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (3390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390457.943601:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788390457.943650:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788390457.943673:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098044032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788390457.943688:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788390457.943724:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098044032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390457.943730:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788390457.943791:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098044160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390457.943809:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098044032:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1788390458.130062:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390458.130071:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390458.131103:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788390458.131115:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788390458.359787:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390458.359835:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088560000 00000100:00100000:0.0:1788390458.359846:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088560000 00000100:00100000:0.0:1788390458.359908:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 152 00000100:00100000:0.0:1788390458.359920:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:12212:x1875263088560000:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390458.359951:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390458.359972:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97fdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360044:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360058:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360080:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360110:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360120:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360127:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360174:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360182:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360189:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360195:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390458.360200:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360207:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360219:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:0.0:1788390458.360223:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390458.360227:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360238:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be97fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360249:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360254:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360260:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360265:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390458.360268:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360274:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360282:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff984fbae78f00) 00010000:00010000:0.0:1788390458.360284:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390458.360287:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360293:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be97fed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360351:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97fdf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f59 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360381:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:0.0:1788390458.360383:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390458.360388:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be97fdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f59 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.360397:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81200, rc 0) 00000100:00100000:0.0:1788390458.360463:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:12212:x1875263088560000:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 546us (683us total) trans 0 rc 301/301 00000100:00100000:0.0:1788390458.360471:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 152 00000100:00100000:3.0:1788390458.371309:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390458.371524:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088560256 00000100:00100000:2.0:1788390458.371534:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088560256 00000100:00100000:2.0:1788390458.371598:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 153 00000100:00100000:2.0:1788390458.371609:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+14:12212:x1875263088560256:12345-192.168.202.11@tcp:36:lfs.0 00010000:00010000:2.0:1788390458.371663:0:12122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390458.371688:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be97933 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d7d expref: 14 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.371712:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:2.0:1788390458.371716:0:12122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390458.371772:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.371785:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f4b expref: 5 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.371793:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.371827:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f4b expref: 5 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.371840:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f4b expref: 5 pid: 6494 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390458.371855:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098044288:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390458.371949:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86833f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390458.375984:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390458.376025:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088560384 00000100:00100000:2.0:1788390458.376034:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088560384 00000100:00100000:3.0:1788390458.376073:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098044288:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390458.376091:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f4b expref: 6 pid: 6494 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.376098:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390458.376130:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 80 00000100:00100000:2.0:1788390458.376141:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2404:x1875263088560384:12345-192.168.202.11@tcp:103:ldlm_bl.0 00000100:00080000:0.0:1788390458.376149:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390458.376155:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390458.376170:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f4b expref: 6 pid: 6494 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.376185:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f4b expref: 6 pid: 6494 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.376207:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be97fb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f4b expref: 6 pid: 6494 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.376222:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:2.0:1788390458.376226:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.376235:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.376242:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.376267:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390458.376316:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088560384:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 176us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.376340:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 80 00010000:00010000:3.0:1788390458.376564:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.376573:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.376594:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.376603:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.376653:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377190:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377200:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377208:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390458.377223:0:12122:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f23436de reply state 000000001aaec890 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377233:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377239:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:3.0:1788390458.377242:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390458.377245:0:12122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788390458.377250:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788390458.377257:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377263:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377269:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377275:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390458.377279:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377296:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377306:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7868300) 00010000:00010000:3.0:1788390458.377308:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390458.377312:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377317:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be97ff4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390458.377500:0:12122:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f23436de reply state 000000001aaec890 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377511:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.377517:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff984fb7863900) 00010000:00010000:3.0:1788390458.377519:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390458.377522:0:12122:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788390458.377601:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:12212:x1875263088560256:12345-192.168.202.11@tcp:36:lfs.0 Request processed in 5987us (6296us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788390458.377610:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 153 00000100:00100000:0.0:1788390458.428295:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390458.428505:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088560512 00000100:00100000:3.0:1788390458.428515:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088560512 00000100:00100000:3.0:1788390458.428567:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 154 00000100:00100000:3.0:1788390458.428575:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+15:12220:x1875263088560512:12345-192.168.202.11@tcp:101:lctl.0 00010000:00010000:3.0:1788390458.428593:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390458.428614:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f60 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.428686:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98010 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.428696:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.428704:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390458.428738:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788390458.428741:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390458.428756:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.428773:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f60 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.428784:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98010 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f60 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.428790:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863800) 00010000:00010000:3.0:1788390458.428792:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390458.428794:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf200, rc 0) 00000100:00100000:3.0:1788390458.428841:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:12220:x1875263088560512:12345-192.168.202.11@tcp:101:lctl.0 Request processed in 268us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390458.428846:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 154 00000100:00100000:3.0:1788390458.449962:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87aa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098044416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390458.450023:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390458.450344:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098044416 00000100:00100000:0.0:1788390458.450353:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098044416 00000100:00080000:1.0:1788390458.450439:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390458.450685:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098044672:0@lo:400:kworker.0 00000100:00100000:1.0:1788390458.450687:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263098044544:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.450736:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390458.450745:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390458.450763:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098045184:0@lo:400:kworker.0 00000100:00100000:1.0:1788390458.450778:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098045056:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.450795:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390458.450806:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390458.450821:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1875263098045696:0@lo:400:kworker.0 00000100:00100000:1.0:1788390458.450827:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098045568:0@lo:400:kworker.0 00000100:00100000:1.0:1788390458.450844:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390458.450863:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788390458.450868:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390458.450872:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263098044928:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.450896:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788390458.450903:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390458.450906:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098044800:0@lo:400:kworker.0 00000100:00100000:1.0:1788390458.450927:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098045440:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.450958:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390458.450977:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098045312:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.450996:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390458.451012:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098045824:0@lo:400:kworker.0 00000100:00100000:1.0:1788390458.451025:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390458.451050:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098045952:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.451052:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390458.451083:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390458.451100:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098044544 00000100:00100000:2.0:1788390458.451105:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098044544 00000100:00100000:1.0:1788390458.451117:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098045056 00000100:00100000:1.0:1788390458.451123:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098045056 00000100:00100000:2.0:1788390458.451147:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788390458.451158:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3623:x1875263098044544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390458.451164:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098044800 00000100:00100000:1.0:1788390458.451168:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098044800 00000100:00100000:1.0:1788390458.451187:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788390458.451195:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098045056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.451211:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3623:x1875263098044544:12345-0@lo:400:kworker.0 Request processed in 53us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.451218:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788390458.451241:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098045056:12345-0@lo:400:kworker.0 Request processed in 46us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390458.451248:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788390458.451257:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098045568 00000100:00100000:2.0:1788390458.451262:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098045568 00000100:00100000:1.0:1788390458.451268:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788390458.451278:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098044800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.451290:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098045440 00000100:00100000:2.0:1788390458.451294:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098045440 00000100:00100000:1.0:1788390458.451307:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098044800:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390458.451312:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788390458.451349:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098045952 00000100:00100000:2.0:1788390458.451353:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098045952 00000100:00100000:2.0:1788390458.451377:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788390458.451384:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098045568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.451423:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098045568:12345-0@lo:400:kworker.0 Request processed in 41us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.451429:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788390458.451442:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788390458.451456:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098045440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.451485:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098045440:12345-0@lo:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.451492:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788390458.451504:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788390458.451516:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098045952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390458.451543:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098045952:12345-0@lo:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.451628:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788390458.451637:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098044416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788390458.451657:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390458.451854:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098044416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 219us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.451861:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788390458.451883:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098044672 00000100:00100000:0.0:1788390458.451887:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098044672 00000100:00100000:0.0:1788390458.451904:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098045184 00000100:00100000:0.0:1788390458.451908:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098045184 00000100:00100000:0.0:1788390458.451921:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098045696 00000100:00100000:0.0:1788390458.451923:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098045696 00000100:00100000:0.0:1788390458.451934:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098044928 00000100:00100000:0.0:1788390458.451954:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098044928 00000100:00100000:0.0:1788390458.451969:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098045312 00000100:00100000:0.0:1788390458.451971:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098045312 00000100:00100000:0.0:1788390458.451989:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098045824 00000100:00100000:0.0:1788390458.451991:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098045824 00000100:00100000:0.0:1788390458.452004:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788390458.452010:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098044672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390458.452042:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098044672:12345-0@lo:400:kworker.0 Request processed in 32us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.452048:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788390458.452299:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788390458.452308:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098045184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390458.452363:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098045184:12345-0@lo:400:kworker.0 Request processed in 52us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.452368:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788390458.452382:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788390458.452388:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875263098045696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390458.452512:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875263098045696:12345-0@lo:400:kworker.0 Request processed in 124us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.452519:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788390458.452538:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788390458.452543:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263098044928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390458.452570:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263098044928:12345-0@lo:400:kworker.0 Request processed in 27us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.452576:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788390458.452586:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788390458.452590:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098045312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390458.452666:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098045312:12345-0@lo:400:kworker.0 Request processed in 75us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.452670:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788390458.452680:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788390458.452684:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098045824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390458.452702:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098045824:12345-0@lo:400:kworker.0 Request processed in 18us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.452705:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788390458.452851:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87aa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098044416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390458.452866:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390458.452872:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098046080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390458.452893:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390458.452993:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098046080 00000100:00100000:0.0:1788390458.452998:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098046080 00000100:00100000:1.0:1788390458.453062:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788390458.453085:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263098044928:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.453101:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098045440:0@lo:400:kworker.0 00000100:00080000:1.0:1788390458.453105:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390458.453110:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788390458.453114:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098045952:0@lo:400:kworker.0 00000100:00080000:1.0:1788390458.453114:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390458.453129:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263098044544:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.453141:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098045056:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.453152:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098045568:0@lo:400:kworker.0 00000100:00100000:0.0:1788390458.453179:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788390458.453186:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098044800:0@lo:400:kworker.0 00000100:00100000:0.0:1788390458.453187:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098046080:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788390458.453198:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8794ad80 x1875263098045312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1788390458.453199:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390458.453208:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8794ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098045312:0@lo:400:kworker.0 00010000:00080000:2.0:1788390458.453218:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e86bc9c00 x1875263098045824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390458.453227:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098045824:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.453237:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098044672:0@lo:400:kworker.0 00000100:00100000:0.0:1788390458.453237:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098046080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.453243:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788390458.453247:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098045184:0@lo:400:kworker.0 00000100:00100000:2.0:1788390458.453260:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1875263098045696:0@lo:400:kworker.0 00000100:00100000:1.0:1788390458.453542:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098046080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390458.473557:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390458.473753:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088560640 00000100:00100000:2.0:1788390458.473764:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088560640 00000100:00100000:2.0:1788390458.473854:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 155 00000100:00100000:2.0:1788390458.473874:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+16:12226:x1875263088560640:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390458.473893:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390458.473913:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be98017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.473995:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474008:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474019:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474689:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474701:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474710:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474791:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1400/0xe156d0713be9802c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474798:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1400/0xe156d0713be9802c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474823:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1400/0xe156d0713be9802c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390458.474859:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788390458.474863:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390458.474881:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1400/0xe156d0713be9802c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474892:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474898:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474905:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474909:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390458.474913:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474931:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474952:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863800) 00010000:00010000:2.0:1788390458.474955:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390458.474959:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474965:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9801e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474988:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.474994:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.475000:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.475005:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390458.475007:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.475012:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.475019:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff984fb7863900) 00010000:00010000:2.0:1788390458.475021:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390458.475024:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.475479:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98025 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.475514:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be98017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f67 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.475528:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1400/0xe156d0713be9802c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f67 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.475547:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:2.0:1788390458.475550:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788390458.475552:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1400, rc 0) 00000100:00100000:2.0:1788390458.477243:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:12226:x1875263088560640:12345-192.168.202.11@tcp:101:bash.0 Request processed in 3369us (3685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.477255:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 155 00000100:00100000:1.0:1788390458.480865:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390458.482353:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088560896 00000100:00100000:3.0:1788390458.482366:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088560896 00000100:00100000:3.0:1788390458.482428:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 156 00000100:00100000:3.0:1788390458.482439:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:12226:x1875263088560896:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390458.482458:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390458.482479:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98033 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f6e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483196:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483213:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483224:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483238:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483244:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483249:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390458.483626:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788390458.483759:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483769:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483776:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483807:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483814:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483821:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483827:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cf000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390458.483830:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483837:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483847:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:3.0:1788390458.483850:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390458.483855:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483870:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9803a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390458.483884:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c0ee08c reply state 000000008b5d9989 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483894:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483900:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863b00) 00010000:00010000:3.0:1788390458.483902:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390458.483905:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788390458.483934:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98033 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f6e expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483960:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f6e expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.483968:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863200) 00010000:00010000:3.0:1788390458.483970:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390458.483972:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cec00, rc 0) 00000100:00100000:3.0:1788390458.484047:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:12226:x1875263088560896:12345-192.168.202.11@tcp:101:bash.0 Request processed in 1609us (3189us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788390458.484054:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 156 00000100:00100000:0.0:1788390458.493551:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390458.493685:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088561024 00000100:00100000:2.0:1788390458.493697:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088561024 00000100:00080000:1.0:1788390458.493766:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390458.493809:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 55 00000100:00100000:2.0:1788390458.493820:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088561024:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390458.493837:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390458.493860:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f75 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390458.493885:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390458.493903:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=279s v=(0 0) 00010000:00010000:2.0:1788390458.493908:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390458.493927:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f75 expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.493957:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f75 expref: 6 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.493970:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba0000, rc 0) 00000100:00100000:2.0:1788390458.494027:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2407:x1875263088561024:12345-192.168.202.11@tcp:101:bash.0 Request processed in 209us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.494048:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 55 00000100:00100000:2.0:1788390458.495847:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390458.495932:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088561152 00000100:00100000:1.0:1788390458.495948:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088561152 00000100:00100000:1.0:1788390458.496182:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 56 00000100:00100000:1.0:1788390458.496192:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:12226:x1875263088561152:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:1.0:1788390458.496207:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390458.496221:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f7c expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.496243:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f75 expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.496249:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390458.496252:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390458.496257:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.496386:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f75 expref: 7 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.496412:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f75 expref: 7 pid: 8407 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390458.496426:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1875263098046208:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390458.496502:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f8caf9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390458.499133:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1875263098046208:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390458.499169:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.499190:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5ce200, rc 0) 00000100:00100000:2.0:1788390458.499297:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:12226:x1875263088561152:12345-192.168.202.11@tcp:101:bash.0 Request processed in 3106us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.499313:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 56 00000100:00100000:0.0:1788390458.505022:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390458.505195:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088561280 00000100:00100000:3.0:1788390458.505206:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088561280 00010000:00010000:3.0:1788390458.505243:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f75 expref: 7 pid: 8407 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390458.505312:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 81 00000100:00100000:3.0:1788390458.505350:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088561280:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390458.505364:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390458.505387:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f75 expref: 7 pid: 8407 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.505402:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f75 expref: 7 pid: 8407 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.505425:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d75dee8/0xe156d0713be98056 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f75 expref: 7 pid: 8407 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.505448:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390458.505452:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390458.505460:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.505471:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.505507:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390458.505520:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87ac3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6477:1875263098046336:192.168.202.11@tcp:105: 00000100:00100000:3.0:1788390458.505617:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f830716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390458.509143:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87ac3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6477:1875263098046336:192.168.202.11@tcp:105: 00010000:00010000:3.0:1788390458.509168:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390458.509226:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2405:x1875263088561280:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 3904us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390458.509236:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 81 00000100:00100000:0.0:1788390458.510376:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390458.510512:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088561536 00000100:00100000:2.0:1788390458.510522:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088561536 00000100:00100000:2.0:1788390458.510587:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 36 00000100:00100000:2.0:1788390458.510597:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:12226:x1875263088561536:12345-192.168.202.11@tcp:35:bash.0 00000100:00100000:2.0:1788390458.510874:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12226:x1875263088561536:12345-192.168.202.11@tcp:35:bash.0 Request processed in 278us (501us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788390458.510882:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 36 00010000:00010000:0.0:1788390458.513720:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390458.572988:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390458.573175:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088561792 00000100:00100000:1.0:1788390458.573186:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088561792 00000100:00100000:1.0:1788390458.573252:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 157 00000100:00100000:1.0:1788390458.573262:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12236:x1875263088561792:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390458.573288:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390458.573345:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f83 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390458.573446:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788390458.573551:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98064 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f83 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.573566:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863800) 00010000:00010000:1.0:1788390458.573569:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390458.573574:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f83 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.573587:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cf600, rc 0) 00000100:00100000:1.0:1788390458.573663:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:12236:x1875263088561792:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 403us (685us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788390458.573686:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 157 00000100:00100000:0.0:1788390458.575873:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390458.575938:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088562048 00000100:00100000:3.0:1788390458.575956:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088562048 00000100:00100000:3.0:1788390458.576061:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 37 00000100:00100000:3.0:1788390458.576071:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:12236:x1875263088562048:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390458.576287:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:12236:x1875263088562048:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 217us (419us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788390458.576294:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 37 00000100:00100000:2.0:1788390458.637707:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390458.637786:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088562176 00000100:00100000:0.0:1788390458.637795:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088562176 00000100:00100000:0.0:1788390458.637844:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 158 00000100:00100000:0.0:1788390458.637851:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:12242:x1875263088562176:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390458.637882:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390458.637901:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f8a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.637975:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98079 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.637989:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.638002:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390458.638050:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788390458.638054:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390458.638070:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.638091:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f8a expref: 25 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.638107:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f8a expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.638116:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390458.638119:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390458.638123:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81800, rc 0) 00000100:00100000:0.0:1788390458.638183:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:12242:x1875263088562176:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 331us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.638190:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 158 00000100:00100000:0.0:1788390458.640850:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390458.640918:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088562432 00000100:00100000:3.0:1788390458.640926:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088562432 00000100:00100000:3.0:1788390458.640992:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 159 00000100:00100000:3.0:1788390458.641002:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:12242:x1875263088562432:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390458.641021:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390458.641039:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98080 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f91 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.641138:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be98087 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.641151:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be98087 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.641179:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be98087 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390458.641192:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788390458.641299:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98080 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f91 expref: 27 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.641316:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be98087 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f91 expref: 26 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.641592:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863200) 00010000:00010000:3.0:1788390458.641596:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390458.641600:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf000, rc 0) 00000100:00100000:2.0:1788390458.641799:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+26:12242:x1875263088562432:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 795us (953us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788390458.641807:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 159 00000100:00100000:1.0:1788390458.647410:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390458.647447:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390458.647470:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088562688 00000100:00100000:0.0:1788390458.647481:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088562688 00000100:00100000:0.0:1788390458.647548:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 160 00000100:00100000:0.0:1788390458.647559:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+26:12242:x1875263088562688:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390458.647582:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390458.647600:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98095 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f98 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.647695:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9809c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.647708:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9809c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.647720:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9809c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390458.647732:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788390458.647836:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98095 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f98 expref: 29 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.647852:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9809c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f98 expref: 28 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.647861:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863200) 00010000:00010000:0.0:1788390458.647864:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788390458.647867:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80a00, rc 0) 00000100:00100000:0.0:1788390458.647933:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+28:12242:x1875263088562688:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 375us (532us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788390458.647988:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 160 00000100:00100000:2.0:1788390458.648071:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088562816 00000100:00100000:2.0:1788390458.648076:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088562816 00000100:00100000:2.0:1788390458.648130:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:2.0:1788390458.648139:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+28:2404:x1875263088562816:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390458.648156:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390458.648172:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be98087 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f91 expref: 28 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.648183:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863200) 00010000:00010000:2.0:1788390458.648186:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390458.648220:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:2404:x1875263088562816:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 82us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.648226:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:1.0:1788390458.651897:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390458.652012:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088562944 00000100:00100000:3.0:1788390458.652021:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088562944 00000100:00100000:3.0:1788390458.652080:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 57 00000100:00100000:3.0:1788390458.652093:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2406:x1875263088562944:12345-192.168.202.11@tcp:1:lfs.0 00010000:00010000:3.0:1788390458.652141:0:8798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.652164:0:8798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.652172:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390458.652177:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390458.652182:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.652238:0:8798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.652253:0:8798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 6 pid: 8408 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390458.652267:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87ac3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8798:1875263098046464:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390458.652385:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071840 going to sleep for 11 seconds 00000100:00100000:0.0:1788390458.654710:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390458.654741:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87ac3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8798:1875263098046464:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390458.654767:0:8798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390458.654808:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088563072 00000100:00100000:1.0:1788390458.654816:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088563072 00002000:00100000:1.0:1788390458.654865:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff984e8884fb80 x1875263088563072/t0(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:74/0 lens 504/0 e 0 to 0 dl 1788390469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390458.654876:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e8884fb80 with x1875263088563072 ext(0->12) 00010000:00010000:1.0:1788390458.654883:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 7 pid: 8408 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.654898:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 7 pid: 8408 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390458.654905:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff984e8884fb80 00000100:00100000:1.0:1788390458.654951:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:1.0:1788390458.654962:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088563072:12345-192.168.202.11@tcp:4:lfs.0 00000100:00100000:1.0:1788390458.656583:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088563072:12345-192.168.202.11@tcp:4:lfs.0 Request processed in 1613us (1872us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788390458.656594:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 2 00002000:00100000:1.0:1788390458.656604:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff984e8884fb80 x1875263088563072/t4294967306(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:74/0 lens 504/448 e 0 to 0 dl 1788390469 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390458.656614:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e8884fb80 with x1875263088563072 ext(0->12) 00010000:00010000:1.0:1788390458.656632:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 9 pid: 8408 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.656649:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 9 pid: 8408 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390458.656657:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff984e8884fb80 00000100:00100000:1.0:1788390458.658542:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390458.658602:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088563200 00000100:00100000:2.0:1788390458.658612:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088563200 00010000:00010000:2.0:1788390458.658648:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 9 pid: 8408 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390458.658685:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 82 00000100:00100000:2.0:1788390458.658695:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88243800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2406:x1875263088563200:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390458.658709:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788390458.658726:0:6479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788390458.658729:0:6479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788390458 00002000:00010000:2.0:1788390458.658732:0:6479:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788390458 00002000:00010000:2.0:1788390458.658735:0:6479:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788390458 00002000:00010000:2.0:1788390458.658748:0:6479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788390458.658755:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 9 pid: 8408 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.658769:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 9 pid: 8408 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.658793:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000706efdfc/0xe156d0713be9805d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f7c expref: 9 pid: 8408 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.658810:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390458.658815:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390458.658820:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.658829:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.658936:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390458.659000:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88243800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2406:x1875263088563200:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 306us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.659008:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 82 00010000:00010000:1.0:1788390458.659055:0:8798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.659066:0:8798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.659087:0:8798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.659095:0:8798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.659153:0:8798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.659162:0:8798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cee00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390458.659166:0:8798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.659186:0:8798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.659197:0:8798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.659205:0:8798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e6408fd/0xe156d0713be980aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390458.659251:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2406:x1875263088562944:12345-192.168.202.11@tcp:1:lfs.0 Request processed in 7162us (7362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390458.659259:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 57 00000100:00100000:0.0:1788390458.662185:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390458.662411:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088563456 00000100:00100000:1.0:1788390458.662420:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088563456 00000100:00100000:1.0:1788390458.662563:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 38 00000100:00100000:1.0:1788390458.662574:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb604d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12242:x1875263088563456:12345-192.168.202.11@tcp:35:lfs.0 00000004:00010000:1.0:1788390458.662633:0:14240:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9809c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f98 expref: 27 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390458.662809:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788390458.662829:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788390458.663087:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788390458.663235:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.663247:0:14240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f6e expref: 31 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.663259:0:14240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.663294:0:14240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f6e expref: 31 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.663309:0:14240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f6e expref: 31 pid: 6494 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390458.663345:0:14240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88240700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14240:1875263098046592:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390458.663476:0:14240:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390458.665342:0:14240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88240700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14240:1875263098046592:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390458.665362:0:14240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390458.665445:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390458.665644:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088563584 00000100:00100000:1.0:1788390458.665651:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088563584 00010000:00010000:1.0:1788390458.665684:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f6e expref: 32 pid: 6494 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390458.665766:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 83 00000100:00100000:1.0:1788390458.665773:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:2405:x1875263088563584:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390458.665784:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390458.665789:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f6e expref: 32 pid: 6494 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.665812:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f6e expref: 32 pid: 6494 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.665828:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98048 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f6e expref: 32 pid: 6494 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.665848:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863200) 00010000:00010000:1.0:1788390458.665852:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.665858:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.665864:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.665886:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390458.665927:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+31:2405:x1875263088563584:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 155us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390458.665932:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 83 00010000:00010000:0.0:1788390458.665982:0:14240:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.665992:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390458.666095:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1788390458.666208:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1788390458.666293:0:14240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14240:1875263098046720:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788390458.666365:0:14240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390458.666390:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098046720 00000100:00100000:0.0:1788390458.666392:0:14240:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982de3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390458.666395:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098046720 00000100:00100000:1.0:1788390458.666421:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788390458.666426:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14240:x1875263098046720:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788390458.666490:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14240:x1875263098046720:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 64us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390458.666494:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788390458.666607:0:14240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14240:1875263098046720:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788390458.666685:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788390458.666715:0:14240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bcbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14240:1875263098046848:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788390458.666736:0:14240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390458.666761:0:14240:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fa248b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390458.666797:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098046848 00000100:00100000:1.0:1788390458.666800:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098046848 00000100:00100000:1.0:1788390458.666819:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788390458.666823:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14240:x1875263098046848:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788390458.666903:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14240:x1875263098046848:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 79us (166us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788390458.666907:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788390458.667005:0:14240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bcbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14240:1875263098046848:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788390458.667029:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788390458.667048:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.667054:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.667058:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.667062:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cfa00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390458.667064:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.667069:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.667077:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863200) 00010000:00010000:2.0:1788390458.667079:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788390458.667082:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.667085:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390458.667180:0:14240:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788390458.667236:0:14240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788390458.667244:0:14240:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 279224922601ns, next at 280224921222ns, rc = 0 00000001:00080000:2.0:1788390458.667249:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788390458.667285:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863200) 00010000:00010000:2.0:1788390458.667288:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788390458.667293:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9809c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f98 expref: 35 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390458.667395:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb604d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+34:12242:x1875263088563456:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 4823us (5215us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788390458.667404:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 38 00000020:00080000:2.0:1788390458.667408:0:14240:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788390458.668615:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390458.668726:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088563712 00000100:00100000:3.0:1788390458.668735:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088563712 00000100:00100000:3.0:1788390458.668784:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 161 00000100:00100000:3.0:1788390458.668794:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+34:12242:x1875263088563712:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390458.668848:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390458.668868:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be980b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243f9f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.668971:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be980b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f9f expref: 35 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.668985:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be980b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f9f expref: 35 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.669003:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:3.0:1788390458.669011:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390458.669015:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20ce400, rc 0) 00000100:00100000:3.0:1788390458.669074:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:12242:x1875263088563712:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 281us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390458.669081:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 161 00000100:00100000:1.0:1788390458.671543:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390458.671597:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088563968 00000100:00100000:3.0:1788390458.671607:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088563968 00000100:00100000:3.0:1788390458.671658:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:3.0:1788390458.671667:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:12242:x1875263088563968:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:2.0:1788390458.671935:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+36:12242:x1875263088563968:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 266us (399us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788390458.671959:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:2.0:1788390458.710004:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390458.710115:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088564224 00000100:00100000:0.0:1788390458.710124:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088564224 00000100:00100000:0.0:1788390458.710190:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 162 00000100:00100000:0.0:1788390458.710200:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+36:12252:x1875263088564224:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390458.710225:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390458.710246:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be980bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fa6 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390458.710491:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788390458.710588:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be980bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fa6 expref: 38 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.710604:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863800) 00010000:00010000:0.0:1788390458.710621:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390458.710629:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be980bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fa6 expref: 38 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.710644:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81c00, rc 0) 00000100:00100000:0.0:1788390458.710712:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:12252:x1875263088564224:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 513us (718us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1788390458.710720:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 162 00000100:00100000:0.0:1788390458.714979:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390458.715084:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088564352 00000100:00100000:2.0:1788390458.715095:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088564352 00000100:00100000:2.0:1788390458.715155:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 163 00000100:00100000:2.0:1788390458.715167:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:12252:x1875263088564352:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:2.0:1788390458.715241:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.715259:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.715271:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.715283:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716509:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716523:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716605:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716614:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716621:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390458.716669:0:8996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716684:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716691:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716698:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716705:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390458.716709:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716717:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716738:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:2.0:1788390458.716741:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390458.716746:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716752:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be980cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716765:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716772:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716778:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716783:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390458.716786:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716793:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716800:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863b00) 00010000:00010000:2.0:1788390458.716803:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390458.716806:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716812:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be980d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716831:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716837:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716843:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716848:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390458.716851:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716857:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716865:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:2.0:1788390458.716867:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390458.716870:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.716876:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1000/0xe156d0713be980db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390458.716968:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:12252:x1875263088564352:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 1802us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390458.716977:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 163 00000100:00100000:2.0:1788390458.719595:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390458.719669:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088564608 00000100:00100000:0.0:1788390458.719678:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088564608 00000100:00100000:0.0:1788390458.719730:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00100000:0.0:1788390458.719739:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:12252:x1875263088564608:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:0.0:1788390458.719929:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:12252:x1875263088564608:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 190us (340us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788390458.719947:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00100000:3.0:1788390458.745499:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390458.745570:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088564864 00000100:00100000:1.0:1788390458.745579:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088564864 00000100:00100000:1.0:1788390458.745635:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 164 00000100:00100000:1.0:1788390458.745645:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:12255:x1875263088564864:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390458.745668:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390458.745688:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be980e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fad expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.745759:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.745772:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.745783:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.745793:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.745800:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.745824:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.745931:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.745953:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.745962:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390458.745970:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788390458.746239:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746248:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746255:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746261:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390458.746266:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746273:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746284:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:1.0:1788390458.746288:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390458.746299:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746305:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be980e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746318:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746451:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746457:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746462:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cfa00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390458.746465:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746471:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746479:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863b00) 00010000:00010000:1.0:1788390458.746482:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390458.746485:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746490:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cfa00/0xe156d0713be980f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746526:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be980e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fad expref: 41 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746553:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fad expref: 40 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.746560:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:1.0:1788390458.746563:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390458.746565:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cf800, rc 0) 00000100:00100000:1.0:1788390458.746627:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+40:12255:x1875263088564864:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 979us (1134us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788390458.746635:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 164 00000100:00100000:1.0:1788390458.748512:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390458.749467:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088564992 00000100:00100000:0.0:1788390458.749477:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088564992 00000100:00100000:0.0:1788390458.749528:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 165 00000100:00100000:0.0:1788390458.749538:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+40:12255:x1875263088564992:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:0.0:1788390458.749597:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.749613:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.749623:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.749669:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.749676:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.749682:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.749688:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390458.749692:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.749699:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.749710:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390458.749712:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390458.749717:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390458.749723:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390458.749782:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+40:12255:x1875263088564992:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 245us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390458.749789:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 165 00000100:00100000:2.0:1788390458.755035:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390458.756079:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088565248 00000100:00100000:0.0:1788390458.756090:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088565248 00000100:00100000:0.0:1788390458.756250:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 41 00000100:00100000:0.0:1788390458.756275:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+40:12255:x1875263088565248:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:0.0:1788390458.756526:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+41:12255:x1875263088565248:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 253us (1553us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788390458.756534:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 41 00000100:00100000:3.0:1788390458.923980:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390458.924089:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088565504 00000100:00100000:2.0:1788390458.924112:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088565504 00000100:00100000:2.0:1788390458.924176:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 166 00000100:00100000:2.0:1788390458.924187:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+41:12286:x1875263088565504:12345-192.168.202.11@tcp:101:cat.0 00010000:00010000:2.0:1788390458.924208:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390458.924228:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be9810c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fb4 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.924376:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98113 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.924390:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.924402:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390458.924413:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788390458.924739:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be9810c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fb4 expref: 44 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.924758:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98113 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fb4 expref: 43 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390458.924767:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:2.0:1788390458.924770:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390458.924773:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1200, rc 0) 00000100:00100000:2.0:1788390458.924832:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:12286:x1875263088565504:12345-192.168.202.11@tcp:101:cat.0 Request processed in 647us (892us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788390458.924839:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 166 00000100:00100000:1.0:1788390458.928902:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390458.929052:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088565632 00000100:00100000:3.0:1788390458.929062:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088565632 00000100:00100000:3.0:1788390458.929122:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:3.0:1788390458.929129:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:2406:x1875263088565632:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390458.929141:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390458.929160:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98113 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fb4 expref: 43 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390458.929174:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:3.0:1788390458.929178:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390458.929222:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+42:2406:x1875263088565632:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390458.929227:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:2.0:1788390458.929272:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390458.929430:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088565888 00000100:00100000:0.0:1788390458.929435:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088565888 00000100:00100000:0.0:1788390458.929471:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 42 00000100:00100000:0.0:1788390458.929480:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+42:12286:x1875263088565888:12345-192.168.202.11@tcp:35:cat.0 00000100:00100000:0.0:1788390458.929666:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:12286:x1875263088565888:12345-192.168.202.11@tcp:35:cat.0 Request processed in 187us (396us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788390458.929673:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 42 00000100:00100000:2.0:1788390458.990685:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390458.991067:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088566144 00000100:00100000:1.0:1788390458.991077:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088566144 00000100:00100000:1.0:1788390458.991138:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 167 00000100:00100000:1.0:1788390458.991149:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:12292:x1875263088566144:12345-192.168.202.11@tcp:101:dd.0 00010000:00010000:1.0:1788390458.991170:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390458.991173:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788390458.991198:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98079 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f8a expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.991220:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:1.0:1788390458.991225:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390458.991239:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98121 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.991380:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.991407:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fad expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.991416:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.991951:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fad expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390458.991967:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fad expref: 43 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390458.991981:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88242300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098046976:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390458.992115:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86bb7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390459.006377:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390459.006471:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88242300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098046976:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390459.006534:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390459.006653:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088566272 00000100:00100000:2.0:1788390459.006662:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088566272 00010000:00010000:2.0:1788390459.006716:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fad expref: 44 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390459.006759:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 84 00000100:00100000:2.0:1788390459.006775:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88243800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+44:2404:x1875263088566272:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390459.006791:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390459.006799:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fad expref: 44 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.006811:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fad expref: 44 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.006832:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be980f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fad expref: 44 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.006848:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:2.0:1788390459.006852:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.006859:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.006866:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788390459.007007:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390459.007009:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390459.007063:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88243800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:2404:x1875263088566272:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 295us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390459.007072:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 84 00010000:00010000:0.0:1788390459.007778:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.007788:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.007807:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788390459.008172:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98121 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fbb expref: 44 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.008185:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fbb expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.008194:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.008197:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390459.008199:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5ce000, rc 0) 00000100:00100000:0.0:1788390459.008281:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:12292:x1875263088566144:12345-192.168.202.11@tcp:101:dd.0 Request processed in 17134us (17607us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788390459.008286:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 167 00000100:00100000:1.0:1788390459.012240:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.012315:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088566400 00000100:00100000:0.0:1788390459.012369:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088566400 00000100:00100000:0.0:1788390459.012481:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 168 00000100:00100000:0.0:1788390459.012489:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:12292:x1875263088566400:12345-192.168.202.11@tcp:101:dd.0 00010000:00010000:0.0:1788390459.012509:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.012525:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98136 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fc2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.012559:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.012572:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.012584:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.012691:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98136 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc2 expref: 45 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.012705:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc2 expref: 44 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.012711:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.012713:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390459.012716:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80a00, rc 0) 00000100:00100000:0.0:1788390459.012771:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+44:12292:x1875263088566400:12345-192.168.202.11@tcp:101:dd.0 Request processed in 283us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390459.012776:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 168 00000100:00100000:2.0:1788390459.015921:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.016047:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088566656 00000100:00100000:0.0:1788390459.016055:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088566656 00000100:00100000:0.0:1788390459.016100:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 169 00000100:00100000:0.0:1788390459.016109:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+44:12292:x1875263088566656:12345-192.168.202.11@tcp:36:dd.0 00010000:00010000:0.0:1788390459.016302:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.016315:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.016438:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390459.016475:0:8996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788390459.016492:0:8996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e21f86e6 reply state 0000000002dd96f7 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.016500:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.016505:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.016507:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788390459.016510:0:8996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390459.016672:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+47:12292:x1875263088566656:12345-192.168.202.11@tcp:36:dd.0 Request processed in 564us (760us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788390459.016678:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 169 00000020:00080000:0.0:1788390459.016681:0:8996:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788390459.205641:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.205746:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088566784 00000100:00100000:0.0:1788390459.205756:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088566784 00000100:00100000:0.0:1788390459.205820:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 170 00000100:00100000:0.0:1788390459.205831:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+47:12306:x1875263088566784:12345-192.168.202.11@tcp:101:stat.0 00010000:00010000:0.0:1788390459.205854:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.205945:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9814b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206013:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206027:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206039:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206049:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206056:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206063:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206133:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206144:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fbb expref: 48 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206169:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206199:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fbb expref: 48 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.206213:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fbb expref: 48 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390459.206228:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098047104:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390459.206412:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982dec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390459.212786:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.212802:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098047104:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390459.212846:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390459.212908:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088567040 00000100:00100000:2.0:1788390459.212917:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088567040 00000100:00100000:2.0:1788390459.212979:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 43 00000100:00100000:2.0:1788390459.212990:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+49:6166:x1875263088567040:12345-192.168.202.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788390459.213246:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+50:6166:x1875263088567040:12345-192.168.202.11@tcp:35:ldlm_bl.0 Request processed in 258us (470us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788390459.213255:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 43 00000100:00100000:1.0:1788390459.216601:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390459.216697:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088567168 00000100:00100000:2.0:1788390459.216707:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088567168 00010000:00010000:2.0:1788390459.216749:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fbb expref: 50 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390459.216828:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 85 00000100:00100000:2.0:1788390459.216839:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+50:2404:x1875263088567168:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390459.216853:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390459.216861:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fbb expref: 50 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.216888:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fbb expref: 50 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.216932:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be98128 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fbb expref: 50 pid: 6492 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.216959:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:2.0:1788390459.216964:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.216975:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.216983:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.217019:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390459.217073:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+49:2404:x1875263088567168:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 236us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390459.217082:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 85 00010000:00010000:0.0:1788390459.219447:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219464:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.219520:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788390459.219525:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390459.219553:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219569:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219596:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219603:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219610:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219617:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.219621:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219628:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219642:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390459.219645:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.219650:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219656:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be98152 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219672:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219678:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219684:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219695:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.219697:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219702:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219710:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863b00) 00010000:00010000:0.0:1788390459.219712:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.219715:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219721:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98159 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219755:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9814b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc9 expref: 49 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219770:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc9 expref: 48 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.219777:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.219779:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390459.219782:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81800, rc 0) 00000100:00100000:0.0:1788390459.219853:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+48:12306:x1875263088566784:12345-192.168.202.11@tcp:101:stat.0 Request processed in 14022us (14221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390459.219862:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 170 00000100:00100000:1.0:1788390459.274150:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.274285:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088567424 00000100:00100000:0.0:1788390459.274398:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088567424 00000100:00100000:0.0:1788390459.274568:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 171 00000100:00100000:0.0:1788390459.274579:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+48:12312:x1875263088567424:12345-192.168.202.11@tcp:36:truncate.0 00010000:00010000:0.0:1788390459.274644:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390459.274672:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be98160 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc9 expref: 48 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.274693:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.274698:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390459.274883:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.274898:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.274909:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390459.274963:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788390459.274984:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030a98fe3 reply state 000000007fb5cd32 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.274996:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.275003:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.275005:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788390459.275008:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390459.275145:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+50:12312:x1875263088567424:12345-192.168.202.11@tcp:36:truncate.0 Request processed in 567us (1007us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788390459.275153:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 171 00000020:00080000:0.0:1788390459.275165:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788390459.353299:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.353396:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088567552 00000100:00100000:0.0:1788390459.353405:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088567552 00000100:00100000:0.0:1788390459.353522:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 172 00000100:00100000:0.0:1788390459.353534:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+50:12326:x1875263088567552:12345-192.168.202.11@tcp:101:stat.0 00010000:00010000:0.0:1788390459.353557:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.353576:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be9816e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fd0 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353645:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353658:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353669:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353680:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353688:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353694:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353765:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353774:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353800:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.353844:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788390459.353849:0:8996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390459.353867:0:8996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353879:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353886:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353892:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353899:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353904:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.353908:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353915:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353927:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390459.353930:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.353946:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353962:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80e00/0xe156d0713be98175 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353978:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353985:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353991:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.353997:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.354000:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.354007:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.354014:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863b00) 00010000:00010000:0.0:1788390459.354016:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.354018:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.354023:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81200/0xe156d0713be9817c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.354050:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81800/0xe156d0713be9816e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd0 expref: 52 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.354063:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd0 expref: 51 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.354076:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.354078:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390459.354081:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5000, rc 0) 00000100:00100000:0.0:1788390459.355279:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+51:12326:x1875263088567552:12345-192.168.202.11@tcp:101:stat.0 Request processed in 1743us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390459.355288:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 172 00000100:00100000:1.0:1788390459.410657:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.410734:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088567808 00000100:00100000:0.0:1788390459.410743:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088567808 00000100:00100000:0.0:1788390459.410792:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 173 00000100:00100000:0.0:1788390459.410803:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+51:12336:x1875263088567808:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390459.410824:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.410842:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9818a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.410971:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788390459.411061:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9818a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd7 expref: 53 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.411076:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863800) 00010000:00010000:0.0:1788390459.411078:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390459.411082:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9818a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd7 expref: 53 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.411095:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:0.0:1788390459.411159:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+52:12336:x1875263088567808:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 359us (509us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788390459.411171:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 173 00000100:00100000:1.0:1788390459.412859:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390459.414096:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088568064 00000100:00100000:2.0:1788390459.414108:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088568064 00000100:00100000:2.0:1788390459.414204:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 44 00000100:00100000:2.0:1788390459.414214:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb604f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+52:12336:x1875263088568064:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:2.0:1788390459.414455:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb604f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+53:12336:x1875263088568064:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 241us (1599us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1788390459.414462:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 44 00000100:00100000:1.0:1788390459.454316:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.454458:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088568320 00000100:00100000:0.0:1788390459.454467:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088568320 00000100:00100000:0.0:1788390459.454532:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 174 00000100:00100000:0.0:1788390459.454543:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+53:12342:x1875263088568320:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:0.0:1788390459.454566:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.454597:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98198 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fde expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.454706:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.454721:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd0 expref: 54 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.454731:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.454765:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd0 expref: 54 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.454778:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd0 expref: 54 pid: 8996 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390459.454790:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098047232:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390459.454876:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982decc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390459.459027:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390459.459081:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088568448 00000100:00100000:2.0:1788390459.459090:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088568448 00010000:00010000:2.0:1788390459.459178:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd0 expref: 55 pid: 8996 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390459.459223:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 86 00000100:00100000:2.0:1788390459.459234:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+55:2404:x1875263088568448:12345-192.168.202.11@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788390459.459514:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098047232:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390459.459543:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.459622:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390459.459631:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd0 expref: 55 pid: 8996 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.459640:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd0 expref: 55 pid: 8996 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.459659:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fd0 expref: 55 pid: 8996 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.459673:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:2.0:1788390459.459676:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.459684:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.459689:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.459707:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390459.459736:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.459745:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390459.459754:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:2404:x1875263088568448:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 522us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390459.459759:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 86 00000004:00200000:0.0:1788390459.459764:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788390459.459891:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98198 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fde expref: 55 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.459908:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fde expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.459916:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.459919:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390459.459922:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:0.0:1788390459.460280:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:12342:x1875263088568320:12345-192.168.202.11@tcp:101:bash.0 Request processed in 5737us (5972us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788390459.460288:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 174 00000100:00100000:1.0:1788390459.462412:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.462528:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088568704 00000100:00100000:0.0:1788390459.462537:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088568704 00000100:00100000:0.0:1788390459.462729:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 175 00000100:00100000:0.0:1788390459.462741:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:12342:x1875263088568704:12345-192.168.202.11@tcp:36:bash.0 00010000:00010000:0.0:1788390459.462964:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.462992:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.463003:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390459.463045:0:8996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788390459.463065:0:8996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bb89699 reply state 0000000031c21f85 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.463076:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.463084:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.463087:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788390459.463090:0:8996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390459.463184:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+57:12342:x1875263088568704:12345-192.168.202.11@tcp:36:bash.0 Request processed in 445us (779us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788390459.463192:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 175 00000020:00080000:0.0:1788390459.463197:0:8996:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788390459.467059:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.467565:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088568832 00000100:00100000:0.0:1788390459.467575:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088568832 00000100:00100000:0.0:1788390459.467650:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 176 00000100:00100000:0.0:1788390459.467661:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+57:12342:x1875263088568832:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:0.0:1788390459.467698:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.467720:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fe5 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.467808:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.467839:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fde expref: 58 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.467848:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.467882:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fde expref: 58 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.467895:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fde expref: 58 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390459.467908:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098047360:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390459.468054:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982decc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390459.471558:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875263098047360:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390459.471688:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390459.471783:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390459.471915:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088568960 00000100:00100000:3.0:1788390459.471947:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088568960 00010000:00010000:3.0:1788390459.471981:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fde expref: 59 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390459.472020:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 87 00000100:00100000:3.0:1788390459.472028:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:2404:x1875263088568960:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390459.472044:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390459.472050:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fde expref: 59 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.472061:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fde expref: 59 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.472081:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9819f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fde expref: 59 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.472206:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:3.0:1788390459.472211:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.472220:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.472227:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.472285:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390459.472384:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:2404:x1875263088568960:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 355us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390459.472400:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 87 00010000:00010000:0.0:1788390459.473771:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.473784:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.473834:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788390459.473837:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390459.473855:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.473901:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fe5 expref: 58 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.473919:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fe5 expref: 57 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.473928:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.473940:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390459.473944:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4600, rc 0) 00000100:00100000:0.0:1788390459.474033:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+57:12342:x1875263088568832:12345-192.168.202.11@tcp:101:bash.0 Request processed in 6373us (6983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390459.474042:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 176 00000100:00100000:1.0:1788390459.476146:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390459.476260:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088569216 00000100:00100000:2.0:1788390459.476282:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088569216 00000100:00100000:2.0:1788390459.476372:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:2.0:1788390459.476384:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+57:12342:x1875263088569216:12345-192.168.202.11@tcp:35:bash.0 00000100:00100000:2.0:1788390459.476620:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:12342:x1875263088569216:12345-192.168.202.11@tcp:35:bash.0 Request processed in 238us (481us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788390459.476628:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:1.0:1788390459.535257:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.535358:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088569472 00000100:00100000:0.0:1788390459.535368:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088569472 00000100:00100000:0.0:1788390459.535423:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 177 00000100:00100000:0.0:1788390459.535434:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:12352:x1875263088569472:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390459.535456:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.535475:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243fec expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.535568:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788390459.535661:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fec expref: 60 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.535675:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863800) 00010000:00010000:0.0:1788390459.535678:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390459.535697:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fec expref: 60 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.535713:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:0.0:1788390459.535816:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:12352:x1875263088569472:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 383us (569us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788390459.535823:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 177 00010000:00010000:2.0:1788390459.537465:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390459.541186:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.541266:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088569600 00000100:00100000:0.0:1788390459.541275:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088569600 00000100:00100000:0.0:1788390459.541360:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 178 00000100:00100000:0.0:1788390459.541371:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:12352:x1875263088569600:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:0.0:1788390459.541446:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541463:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541475:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541486:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541493:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541499:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541566:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541587:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541595:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390459.541640:0:8996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541653:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541659:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541666:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541671:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.541676:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541683:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541695:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390459.541698:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.541703:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541708:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541730:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541736:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541743:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541748:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.541750:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541757:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541765:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863b00) 00010000:00010000:0.0:1788390459.541767:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.541770:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541776:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541785:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541791:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541796:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541807:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.541810:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541816:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541823:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.541825:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.541827:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.541833:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390459.541897:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:12352:x1875263088569600:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 528us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390459.541904:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 178 00000100:00100000:1.0:1788390459.543617:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390459.543701:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088569856 00000100:00100000:2.0:1788390459.543710:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088569856 00000100:00100000:2.0:1788390459.543759:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 46 00000100:00100000:2.0:1788390459.543769:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:12352:x1875263088569856:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:2.0:1788390459.543985:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:12352:x1875263088569856:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 217us (382us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788390459.543993:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 46 00000100:00100000:1.0:1788390459.571494:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.571972:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088570112 00000100:00100000:0.0:1788390459.572046:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088570112 00000100:00100000:0.0:1788390459.572154:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 179 00000100:00100000:0.0:1788390459.572165:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:12355:x1875263088570112:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390459.572192:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.572216:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ff3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572291:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572437:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572451:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572464:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572471:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572478:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572580:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572590:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572597:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.572606:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788390459.572683:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572690:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572696:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572708:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.572713:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572721:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572734:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390459.572737:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.572742:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572749:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be981ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572764:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572770:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572776:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572780:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.572783:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572789:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572807:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863b00) 00010000:00010000:0.0:1788390459.572944:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.572947:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.572953:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be981f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.573004:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be981e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ff3 expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.573018:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ff3 expref: 62 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.573025:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.573028:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390459.573030:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:0.0:1788390459.573135:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:12355:x1875263088570112:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 971us (1649us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788390459.573143:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 179 00000100:00100000:1.0:1788390459.577783:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390459.577916:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.578160:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088570368 00000100:00100000:0.0:1788390459.578170:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088570368 00000100:00100000:0.0:1788390459.578236:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 14 00000100:00100000:0.0:1788390459.578247:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:2406:x1875263088570368:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390459.578264:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390459.578288:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be981fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ff3 expref: 62 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.578349:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.578355:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390459.578414:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:2406:x1875263088570368:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 168us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390459.578422:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 14 00000100:00100000:3.0:1788390459.578954:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088570240 00000100:00100000:3.0:1788390459.578961:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088570240 00000100:00100000:3.0:1788390459.579036:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 180 00000100:00100000:3.0:1788390459.579045:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:12355:x1875263088570240:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:3.0:1788390459.579104:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.579118:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.579128:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.579163:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.579169:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.579175:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.579181:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390459.579185:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.579192:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.579201:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:3.0:1788390459.579212:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390459.579217:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.579223:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98208 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390459.579278:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:12355:x1875263088570240:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 233us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390459.579284:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 180 00000100:00100000:1.0:1788390459.582036:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.582515:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088570624 00000100:00100000:0.0:1788390459.582525:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088570624 00000100:00100000:0.0:1788390459.582687:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:0.0:1788390459.582699:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+61:12355:x1875263088570624:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:0.0:1788390459.582914:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:12355:x1875263088570624:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 216us (886us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788390459.582921:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:2.0:1788390459.695547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.695789:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088570880 00000100:00100000:0.0:1788390459.695800:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088570880 00000100:00100000:0.0:1788390459.696075:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 181 00000100:00100000:0.0:1788390459.696088:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+62:12373:x1875263088570880:12345-192.168.202.11@tcp:101:cat.0 00010000:00010000:0.0:1788390459.696112:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.696132:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9820f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e243ffa expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.696232:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98216 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.696248:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98216 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.696275:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98216 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.696286:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788390459.696497:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9820f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ffa expref: 65 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.696518:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98216 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ffa expref: 64 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.696527:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.696530:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788390459.696533:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4800, rc 0) 00000100:00100000:0.0:1788390459.696959:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+64:12373:x1875263088570880:12345-192.168.202.11@tcp:101:cat.0 Request processed in 504us (1053us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788390459.696975:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 181 00000100:00100000:1.0:1788390459.714247:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.714426:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088571008 00000100:00100000:0.0:1788390459.714442:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088571008 00000100:00100000:0.0:1788390459.714529:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 182 00000100:00100000:0.0:1788390459.714537:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+64:12374:x1875263088571008:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390459.714558:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.714574:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244001 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.714645:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9822b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.714670:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9822b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.714678:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9822b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.714713:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788390459.714716:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390459.714729:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9822b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.714749:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244001 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.714764:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9822b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244001 expref: 65 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.714770:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390459.714772:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390459.714774:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5400, rc 0) 00000100:00100000:0.0:1788390459.714944:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:12374:x1875263088571008:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 406us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390459.714950:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 182 00000100:00100000:2.0:1788390459.718152:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.718229:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088571392 00000100:00100000:0.0:1788390459.718238:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088571392 00000100:00100000:0.0:1788390459.718308:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 48 00000100:00100000:0.0:1788390459.718316:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:12374:x1875263088571392:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:0.0:1788390459.718557:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12374:x1875263088571392:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 242us (413us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788390459.718573:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 48 00000100:00100000:1.0:1788390459.722803:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390459.722880:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088571520 00000100:00100000:2.0:1788390459.722889:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088571520 00000100:00100000:2.0:1788390459.722956:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:2.0:1788390459.722967:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12374:x1875263088571520:12345-192.168.202.11@tcp:103:lfs.0 00010000:00010000:2.0:1788390459.722982:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788390459.723003:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be981bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fe5 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.723019:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98216 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ffa expref: 65 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.723037:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be980b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f9f expref: 64 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390459.723044:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:2.0:1788390459.723047:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390459.723096:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:12374:x1875263088571520:12345-192.168.202.11@tcp:103:lfs.0 Request processed in 132us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390459.723101:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:1.0:1788390459.724278:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390459.724534:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088571648 00000100:00100000:3.0:1788390459.724541:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088571648 00000100:00100000:3.0:1788390459.724578:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 183 00000100:00100000:3.0:1788390459.724588:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:12374:x1875263088571648:12345-192.168.202.11@tcp:58:lfs.0 00010000:00010000:3.0:1788390459.724679:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.724690:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390459.724698:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390459.724775:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788390459.724832:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:12374:x1875263088571648:12345-192.168.202.11@tcp:58:lfs.0 Request processed in 245us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390459.724839:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 183 00000100:00100000:1.0:1788390459.735214:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390459.735505:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088571776 00000100:00100000:0.0:1788390459.735515:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088571776 00000100:00100000:0.0:1788390459.735612:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 184 00000100:00100000:0.0:1788390459.735620:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:12376:x1875263088571776:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390459.735638:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390459.735654:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98239 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244008 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735724:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735735:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735743:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735750:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735754:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735757:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735810:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735824:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735828:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390459.735862:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788390459.735865:0:12122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390459.735877:0:12122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735886:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735891:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735895:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735899:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735903:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.735906:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735911:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735920:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390459.735926:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.735943:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735954:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98240 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735971:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735976:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735982:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735988:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390459.735990:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.735995:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.736000:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863b00) 00010000:00010000:0.0:1788390459.736002:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390459.736004:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.736007:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98247 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.736027:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98239 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244008 expref: 65 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.736045:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244008 expref: 64 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390459.736050:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:0.0:1788390459.736051:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390459.736053:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4800, rc 0) 00000100:00100000:0.0:1788390459.736151:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+64:12376:x1875263088571776:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 531us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390459.736157:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 184 00000040:00080000:3.0:1788390460.189010:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788390460.189020:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390460.189138:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:3.0:1788390460.189151:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390460.189317:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87ac2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098047488:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788390460.189457:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fa1683780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390460.192988:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87ac2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098047488:192.168.202.11@tcp:107:hsm_cdtr.0 00000001:00080000:0.0:1788390460.193071:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00010000:00010000:1.0:1788390460.193123:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193143:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390460.193143:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:1.0:1788390460.193158:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193168:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfe00 already unused, calling callback (ffffffffc19ce4f0) 00000020:00080000:0.0:1788390460.193173:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984e86833780 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:1.0:1788390460.193176:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390460.193182:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e88870800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984e86833a80 00000020:00080000:0.0:1788390460.193192:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e88870500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984e8834ec00 00010000:00010000:1.0:1788390460.193198:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390460.193232:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00010000:00010000:1.0:1788390460.193237:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff984fb7863900) 00010000:00010000:1.0:1788390460.193243:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390460.193251:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390460.193252:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:1.0:1788390460.193267:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be97ffb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193296:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390460.193299:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788390460.193306:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193315:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193352:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfa00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390460.193355:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193362:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193376:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:1.0:1788390460.193379:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390460.193383:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193389:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be98002 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193419:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193426:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193433:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193438:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfc00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390460.193441:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193447:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193456:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863b00) 00010000:00010000:1.0:1788390460.193458:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390460.193461:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193468:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be98041 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193485:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193491:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193496:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193507:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390460.193510:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193515:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193524:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:1.0:1788390460.193527:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390460.193529:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193535:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98144 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193549:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193555:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193561:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193565:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390460.193568:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193574:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193591:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:1.0:1788390460.193593:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390460.193596:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193602:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98167 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193613:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193725:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193734:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193740:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390460.193744:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193751:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193761:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00000100:00100000:3.0:1788390460.193764:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098047616:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788390460.193766:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390460.193772:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.193780:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be981ad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390460.193838:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390460.193922:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098047616 00000100:00100000:1.0:1788390460.193943:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098047616 00000100:00100000:1.0:1788390460.194029:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788390460.194041:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098047616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788390460.194082:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1788390460.194124:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a98ac3a, atime: 0x6a98ac3a, ctime: 0x6a98ac3a, blocks: 0x8 00010000:00010000:1.0:1788390460.194132:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.194149:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=280s v=(0 0) 00010000:00010000:1.0:1788390460.194154:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390460.194162:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.194180:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.194190:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.194198:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.194218:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788390460.194433:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3624:x1875263098047616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 392us (593us total) trans 4294967308 rc 0/0 00000100:00080000:3.0:1788390460.194450:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390460.194451:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1788390460.194493:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390460.194500:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390460.194504:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e87ac2a00/2, rc 0, transno 4294967308 00010000:00010000:1.0:1788390460.194518:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cfa00 already unused, calling callback (ffffffffc0dd6230) 00000100:00100000:3.0:1788390460.194521:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098047616:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788390460.194525:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.194537:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.194554:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.194561:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007509341f/0xe156d0713be98255 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.194579:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390460.194581:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390460.194582:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390460.196188:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390460.196822:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088571904 00000100:00100000:1.0:1788390460.196837:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088571904 00000100:00100000:1.0:1788390460.196909:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 185 00000100:00100000:1.0:1788390460.196921:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:12387:x1875263088571904:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788390460.196972:0:6492:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788390460.197126:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:12387:x1875263088571904:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 206us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390460.197134:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 185 00000100:00100000:2.0:1788390460.202109:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.211162:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088572032 00000100:00100000:3.0:1788390460.211178:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088572032 00000100:00100000:2.0:1788390460.213956:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 186 00000100:00100000:2.0:1788390460.213981:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:12387:x1875263088572032:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788390460.214079:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.214101:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.214116:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.214252:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.214276:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.214290:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214610:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214625:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214635:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390460.214800:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788390460.214806:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390460.214823:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214839:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214846:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214853:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214860:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390460.214865:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214873:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214899:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:1.0:1788390460.214902:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390460.214907:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214913:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be9825c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214942:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214948:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214955:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214960:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390460.214963:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214970:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214978:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff984f8379b000) 00010000:00010000:1.0:1788390460.214980:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390460.214984:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.214990:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98263 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.215063:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.215071:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.215077:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.215082:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390460.215085:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.215092:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.215100:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:1.0:1788390460.215103:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390460.215106:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.215112:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0000/0xe156d0713be9826a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.215262:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:12387:x1875263088572032:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 Request processed in 1287us (13161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390460.215273:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 186 00000100:00100000:1.0:1788390460.221791:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390460.221854:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088572288 00000100:00100000:2.0:1788390460.221870:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088572288 00000100:00100000:2.0:1788390460.222016:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 187 00000100:00100000:2.0:1788390460.222029:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+17:12387:x1875263088572288:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390460.222055:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390460.222083:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0a00/0xe156d0713be98271 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24400f expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222217:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222233:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222245:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390460.222256:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788390460.222382:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222391:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222398:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222404:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390460.222409:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222498:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222515:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:2.0:1788390460.222519:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390460.222524:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222530:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0800/0xe156d0713be98278 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222583:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0a00/0xe156d0713be98271 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24400f expref: 19 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222595:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:2.0:1788390460.222597:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390460.222602:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0a00/0xe156d0713be98271 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24400f expref: 19 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.222616:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba0a00, rc 0) 00000100:00100000:2.0:1788390460.222691:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:12387:x1875263088572288:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 665us (915us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1788390460.222700:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 187 00000100:00100000:0.0:1788390460.229003:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390460.229060:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088572416 00000100:00100000:2.0:1788390460.229073:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088572416 00000100:00100000:2.0:1788390460.229190:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 188 00000100:00100000:2.0:1788390460.229203:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:12387:x1875263088572416:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788390460.229261:0:6492:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788390460.229540:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:12387:x1875263088572416:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 339us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390460.229549:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 188 00000100:00100000:2.0:1788390460.234013:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390460.234115:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088572672 00000100:00100000:1.0:1788390460.234127:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088572672 00000100:00100000:1.0:1788390460.234208:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 189 00000100:00100000:1.0:1788390460.234220:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:12387:x1875263088572672:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390460.234246:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390460.234249:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788390460.234284:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9822b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244001 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.234305:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:1.0:1788390460.234310:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390460.234360:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be98286 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244016 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788390460.235069:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788390460.235249:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be9828d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.235265:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be9828d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.235276:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be9828d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.235509:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be98286 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244016 expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.235528:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be9828d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244016 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.235538:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fba803a00) 00010000:00010000:1.0:1788390460.235549:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390460.235553:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5ce200, rc 0) 00000100:00100000:1.0:1788390460.235841:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:12387:x1875263088572672:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 1621us (1837us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788390460.235850:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 189 00000100:00100000:0.0:1788390460.240634:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.240729:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088572928 00000100:00100000:3.0:1788390460.240741:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088572928 00000100:00100000:3.0:1788390460.240854:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 190 00000100:00100000:3.0:1788390460.240870:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:12387:x1875263088572928:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390460.240969:0:12122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390460.241043:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be9828d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244016 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241066:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fba803a00) 00010000:00010000:3.0:1788390460.241079:0:12122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390460.241115:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241132:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241142:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241283:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241304:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241315:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241449:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241457:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241465:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241471:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cf600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390460.241476:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241485:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241500:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:3.0:1788390460.241504:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390460.241509:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241516:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be9829b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241552:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241559:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241565:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241570:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cea00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390460.241573:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241579:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241587:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8c5d845e (ffff984fb7863e00) 00010000:00010000:3.0:1788390460.241589:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390460.241592:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.241597:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8c5d845e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390460.241729:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:12387:x1875263088572928:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 857us (1106us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390460.241740:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 190 00000100:00100000:1.0:1788390460.244519:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.244566:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088573056 00000100:00100000:3.0:1788390460.244583:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088573056 00000100:00100000:3.0:1788390460.244659:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 191 00000100:00100000:3.0:1788390460.244683:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:12387:x1875263088573056:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390460.244704:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390460.244727:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24401d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.244762:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.244775:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.244787:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.244911:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24401d expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.244941:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24401d expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.244951:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:3.0:1788390460.244954:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788390460.244958:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfa00, rc 0) 00000100:00100000:3.0:1788390460.245029:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:12387:x1875263088573056:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 348us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.245036:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 191 00000100:00100000:1.0:1788390460.251251:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.251685:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088573312 00000100:00100000:3.0:1788390460.251697:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088573312 00000100:00100000:3.0:1788390460.251759:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 192 00000100:00100000:3.0:1788390460.251784:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:12387:x1875263088573312:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390460.251872:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.251887:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.251912:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390460.252108:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788390460.252121:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 280809798518ns, next at 281809795006ns, rc = 0 00000004:00010000:3.0:1788390460.252174:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000424dbf0b reply state 0000000030f39cb8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.252187:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.252195:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:3.0:1788390460.252198:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788390460.252201:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390460.252302:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12387:x1875263088573312:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 519us (1062us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788390460.252310:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 192 00000100:00100000:1.0:1788390460.254164:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.254234:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088573440 00000100:00100000:3.0:1788390460.254241:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088573440 00000100:00100000:3.0:1788390460.254307:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 193 00000100:00100000:3.0:1788390460.254316:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12387:x1875263088573440:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390460.254508:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390460.254539:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244024 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.254584:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244024 expref: 22 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.254593:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244024 expref: 22 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.254606:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:3.0:1788390460.254608:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390460.254611:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cea00, rc 0) 00000100:00100000:3.0:1788390460.254650:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:12387:x1875263088573440:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 337us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.254655:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 193 00000100:00100000:1.0:1788390460.256152:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.256233:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088573568 00000100:00100000:3.0:1788390460.256241:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088573568 00000100:00100000:3.0:1788390460.256347:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:3.0:1788390460.256356:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+6:2406:x1875263088573568:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788390460.256668:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2406:x1875263088573568:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 312us (522us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788390460.256673:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00080000:1.0:1788390460.256730:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390460.258548:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390460.258662:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088573824 00000100:00100000:0.0:1788390460.258678:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088573824 00000100:00100000:0.0:1788390460.258751:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 49 00000100:00100000:0.0:1788390460.258763:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:12387:x1875263088573824:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390460.259369:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:12387:x1875263088573824:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 596us (816us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788390460.259387:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 49 00000100:00100000:0.0:1788390460.262180:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390460.263753:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088574080 00000100:00100000:1.0:1788390460.263763:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088574080 00000100:00100000:1.0:1788390460.263824:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 194 00000100:00100000:1.0:1788390460.263837:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:12387:x1875263088574080:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788390460.263970:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:12387:x1875263088574080:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 137us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390460.263978:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 194 00000100:00100000:1.0:1788390460.265816:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.265857:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088574208 00000100:00100000:3.0:1788390460.265864:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088574208 00000100:00100000:3.0:1788390460.265918:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 195 00000100:00100000:3.0:1788390460.265940:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:12387:x1875263088574208:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390460.265958:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390460.265985:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24402b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.266051:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.266065:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.266076:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390460.266128:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390460.266148:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.266173:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24402b expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.266189:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24402b expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.266198:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:3.0:1788390460.266201:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788390460.266204:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfe00, rc 0) 00000100:00100000:3.0:1788390460.268236:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:12387:x1875263088574208:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 2302us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.268246:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 195 00000100:00100000:3.0:1788390460.273982:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390460.274994:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088574336 00000100:00100000:1.0:1788390460.275005:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088574336 00000100:00100000:1.0:1788390460.275075:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:1.0:1788390460.275088:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088574336:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390460.275109:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390460.275133:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244032 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390460.275175:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac3c, blocks: 0x0 00010000:00010000:1.0:1788390460.275195:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=280s v=(0 0) 00010000:00010000:1.0:1788390460.275199:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390460.275206:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244032 expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.275220:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244032 expref: 8 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.275230:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cf600, rc 0) 00000100:00100000:1.0:1788390460.275276:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088574336:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 193us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390460.275280:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:3.0:1788390460.279116:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.279165:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088574592 00000100:00100000:3.0:1788390460.279176:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088574592 00000100:00100000:3.0:1788390460.279225:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 196 00000100:00100000:3.0:1788390460.279235:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:12387:x1875263088574592:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390460.279362:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:12387:x1875263088574592:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 128us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.279372:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 196 00000100:00100000:0.0:1788390460.288761:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390460.288815:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088574720 00000100:00100000:0.0:1788390460.288826:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088574720 00000100:00100000:0.0:1788390460.288878:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 61 00000100:00100000:0.0:1788390460.288891:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:12387:x1875263088574720:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390460.288910:0:8798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390460.288939:0:8798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244039 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.288972:0:8798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244032 expref: 9 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.288982:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390460.288986:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390460.288993:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 9 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.289032:0:8798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244032 expref: 9 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.289048:0:8798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244032 expref: 9 pid: 8409 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390460.289062:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098047744:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390460.289159:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982de840 going to sleep for 11 seconds 00000100:00100000:0.0:1788390460.292524:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098047744:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390460.292562:0:8798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 9 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.292586:0:8798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:0.0:1788390460.292654:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:12387:x1875263088574720:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 3765us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390460.292662:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 61 00000100:00100000:0.0:1788390460.293734:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.293831:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088574848 00000100:00100000:3.0:1788390460.293838:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088574848 00010000:00010000:3.0:1788390460.293872:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244032 expref: 9 pid: 8409 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390460.293914:0:14672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390460.293919:0:14672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390460.293960:0:14672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:1.0:1788390460.293970:0:14672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390460.294030:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 88 00000100:00100000:3.0:1788390460.294041:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088574848:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390460.294055:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390460.294129:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244032 expref: 9 pid: 8409 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.294143:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244032 expref: 9 pid: 8409 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.294166:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d62b56/0xe156d0713be982d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244032 expref: 9 pid: 8409 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.294185:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390460.294190:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390460.294206:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 8 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.294216:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 8 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.294253:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 8 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390460.294269:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87ac0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6478:1875263098047872:192.168.202.11@tcp:105: 00000100:00100000:3.0:1788390460.294372:0:6478:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fa1683780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390460.300996:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87ac0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6478:1875263098047872:192.168.202.11@tcp:105: 00010000:00010000:3.0:1788390460.301014:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390460.301073:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088574848:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 7032us (7340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.301082:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 88 00000100:00100000:2.0:1788390460.307889:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390460.312200:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088574976 00000100:00100000:0.0:1788390460.312214:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088574976 00002000:00100000:0.0:1788390460.312271:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff984e88243800 x1875263088574976/t0(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:76/0 lens 504/0 e 0 to 0 dl 1788390471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390460.312283:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e88243800 with x1875263088574976 ext(0->8) 00002000:00010000:0.0:1788390460.312288:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e88243800 00000100:00100000:0.0:1788390460.312342:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 4 00000100:00100000:0.0:1788390460.312353:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088574976:12345-192.168.202.11@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788390460.313186:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2404:x1875263088574976:12345-192.168.202.11@tcp:4:lhsmtool_posix.0 Request processed in 833us (5305us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788390460.313195:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 4 00002000:00100000:0.0:1788390460.313203:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff984e88243800 x1875263088574976/t4294967315(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:76/0 lens 504/448 e 0 to 0 dl 1788390471 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390460.313211:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e88243800 with x1875263088574976 ext(0->8) 00002000:00010000:0.0:1788390460.313220:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e88243800 00000100:00100000:3.0:1788390460.328197:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390460.328279:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088575104 00000100:00100000:1.0:1788390460.328289:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088575104 00000100:00100000:1.0:1788390460.328369:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 197 00000100:00100000:1.0:1788390460.328380:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:12387:x1875263088575104:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788390460.330079:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1788390460.330093:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:2.0:1788390460.330164:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.330176:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.330184:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.330190:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfc00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390460.330195:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.330201:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.330216:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:2.0:1788390460.330220:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788390460.330224:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.330230:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfc00/0xe156d0713be982b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390460.331505:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390460.331525:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098048000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788390460.331597:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390460.331642:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098048000 00000100:00100000:3.0:1788390460.331650:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098048000 00000100:00100000:3.0:1788390460.331713:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788390460.331723:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098048000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788390460.331836:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788390460.331840:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788390460 00002000:00010000:3.0:1788390460.331849:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788390460.331851:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788390460 -> 1788390460 00002000:00010000:3.0:1788390460.331854:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788390460.331895:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098048000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (298us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788390460.331903:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788390460.331938:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788390460.331972:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e883fbb80/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788390460.331978:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098048000:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1788390460.332627:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788390460.332702:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788390460.332713:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788390460.332968:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:12387:x1875263088575104:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 Request processed in 4586us (4777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.332978:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 197 00000100:00100000:1.0:1788390460.334862:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.334984:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088575232 00000100:00100000:3.0:1788390460.334993:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088575232 00000100:00100000:3.0:1788390460.335040:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 63 00000100:00100000:3.0:1788390460.335051:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2405:x1875263088575232:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788390460.337091:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1788390460.337103:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788390460.337246:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088575232:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 Request processed in 2192us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.337256:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 63 00000100:00100000:0.0:1788390460.342172:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.342653:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088575488 00000100:00100000:3.0:1788390460.342711:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088575488 00000100:00100000:3.0:1788390460.342772:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 198 00000100:00100000:3.0:1788390460.342784:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:12387:x1875263088575488:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390460.342839:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390460.342877:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24402b expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.342895:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:3.0:1788390460.342901:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390460.342945:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.342960:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.342970:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390460.343085:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002af8776c reply state 0000000040198769 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.343097:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.343103:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:3.0:1788390460.343106:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390460.343109:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390460.343206:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:12387:x1875263088575488:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 424us (1042us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788390460.343215:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 198 00000100:00100000:0.0:1788390460.346085:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390460.346186:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088575616 00000100:00100000:2.0:1788390460.346204:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088575616 00000100:00100000:2.0:1788390460.346291:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 64 00000100:00100000:2.0:1788390460.346302:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088575616:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788390460.346494:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788390460.346498:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788390460 -> 1788390459 00002000:00010000:2.0:1788390460.346501:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788390458 00002000:00010000:2.0:1788390460.346503:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788390460 -> 1788390459 00002000:00010000:2.0:1788390460.346506:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788390460.346562:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088575616:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 261us (485us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788390460.346571:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 64 00000100:00100000:2.0:1788390460.349815:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390460.349891:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088575872 00000100:00100000:0.0:1788390460.349900:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088575872 00000100:00100000:0.0:1788390460.349964:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 199 00000100:00100000:0.0:1788390460.349976:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:12387:x1875263088575872:12345-192.168.202.11@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788390460.350042:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.350058:0:8996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24401d expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.350067:0:8996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.350102:0:8996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24401d expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.350117:0:8996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24401d expref: 20 pid: 6492 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390460.350130:0:8996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098048128:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390460.350210:0:8996:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982de600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390460.352464:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.352495:0:8996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098048128:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390460.352523:0:8996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.352596:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088576000 00000100:00100000:1.0:1788390460.352604:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088576000 00010000:00010000:1.0:1788390460.352637:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24401d expref: 21 pid: 6492 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.352723:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 89 00000100:00100000:1.0:1788390460.352733:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:2405:x1875263088576000:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390460.352746:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390460.352753:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24401d expref: 21 pid: 6492 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.352765:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24401d expref: 21 pid: 6492 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.352786:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfa00/0xe156d0713be982b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24401d expref: 21 pid: 6492 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.352799:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:1.0:1788390460.352804:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.352813:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.352821:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.352878:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390460.352948:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:2405:x1875263088576000:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 216us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390460.352956:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 89 00010000:00010000:3.0:1788390460.352998:0:8996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.353012:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.353048:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.353055:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.353061:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.353067:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390460.353071:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.353078:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.353087:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:3.0:1788390460.353090:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788390460.353094:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.353101:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be982e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390460.353142:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:12387:x1875263088575872:12345-192.168.202.11@tcp:55:lhsmtool_posix.0 Request processed in 3169us (3337us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788390460.353150:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 199 00000100:00100000:1.0:1788390460.354774:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390460.354823:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088576128 00000100:00100000:2.0:1788390460.354831:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088576128 00000100:00100000:2.0:1788390460.354881:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 65 00000100:00100000:2.0:1788390460.354893:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088576128:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788390460.354942:0:8798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.354961:0:8798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 8 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.354969:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390460.354973:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390460.354978:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.355020:0:8798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 8 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.355035:0:8798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 8 pid: 8798 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390460.355049:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098048256:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390460.355122:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390460.359859:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390460.359890:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088576256 00000100:00100000:0.0:1788390460.359901:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088576256 00010000:00010000:0.0:1788390460.359965:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 9 pid: 8798 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390460.360022:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 90 00000100:00100000:0.0:1788390460.360032:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2404:x1875263088576256:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390460.360047:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390460.360068:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 9 pid: 8798 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.360083:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 9 pid: 8798 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.360110:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390460.360115:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390460.360121:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.360131:0:10369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390460.360149:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390460.360198:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2404:x1875263088576256:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 167us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390460.360206:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 90 00010000:00010000:2.0:1788390460.362714:0:8798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc46da14/0xe156d0713be982da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244039 expref: 8 pid: 8798 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390460.362810:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098048256:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390460.362837:0:8798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.362849:0:8798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.362857:0:8798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.362887:0:8798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.362908:0:8798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.362918:0:8798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.362936:0:8798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390460.362941:0:8798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.362950:0:8798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.362970:0:8798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.362977:0:8798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030506e30/0xe156d0713be982ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390460.363076:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088576128:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 Request processed in 8184us (8307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390460.363085:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 65 00000100:00100000:2.0:1788390460.366917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.366976:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088576512 00000100:00100000:3.0:1788390460.366986:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088576512 00000100:00100000:3.0:1788390460.367044:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 200 00000100:00100000:3.0:1788390460.367054:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:12387:x1875263088576512:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788390460.367132:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.367151:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc2 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.367161:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.367211:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc2 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.367225:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc2 expref: 19 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390460.367239:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098048384:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390460.367348:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390460.370203:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.370257:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098048384:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390460.370275:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088576640 00000100:00100000:2.0:1788390460.370283:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088576640 00010000:00010000:3.0:1788390460.370284:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.370374:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc2 expref: 20 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390460.370417:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 91 00000100:00100000:2.0:1788390460.370428:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:2405:x1875263088576640:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390460.370442:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390460.370448:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc2 expref: 20 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.370460:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc2 expref: 20 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.370481:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9813d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243fc2 expref: 20 pid: 6493 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.370495:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:2.0:1788390460.370501:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.370512:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.370520:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390460.370548:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390460.370602:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:2405:x1875263088576640:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 175us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390460.370612:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 91 00010000:00010000:3.0:1788390460.370855:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.370864:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.371030:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.371043:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244024 expref: 19 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.371051:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.371076:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244024 expref: 19 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.371087:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244024 expref: 19 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390460.371100:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098048512:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390460.371156:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b99cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390460.375990:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.376064:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098048512:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390460.376092:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.376105:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088576768 00000100:00100000:1.0:1788390460.376114:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088576768 00010000:00010000:1.0:1788390460.376150:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244024 expref: 20 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.376186:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 92 00000100:00100000:1.0:1788390460.376196:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:2404:x1875263088576768:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390460.376209:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390460.376216:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244024 expref: 20 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.376230:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244024 expref: 20 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.376251:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cea00/0xe156d0713be982be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244024 expref: 20 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.376265:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:1.0:1788390460.376270:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.376279:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.376286:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.376318:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390460.376410:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.376419:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.376429:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:2404:x1875263088576768:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 232us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390460.376437:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 92 00000001:00080000:3.0:1788390460.376522:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788390460.376650:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788390460.376695:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788390460.377066:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6493:1875263098048640:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788390460.377112:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390460.377144:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390460.377846:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098048640 00000100:00100000:1.0:1788390460.377854:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098048640 00000100:00100000:1.0:1788390460.377903:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788390460.377912:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1875263098048640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788390460.378182:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6493:x1875263098048640:12345-0@lo:1000:mdt00_001.0 Request processed in 108us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390460.378192:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788390460.379228:0:6493:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788390460.379243:0:6493:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984e883fbb80, transno 4294967316 00000100:00100000:3.0:1788390460.379273:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6493:1875263098048640:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788390460.379453:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788390460.379518:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6493:1875263098048768:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788390460.379577:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390460.379612:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb0696c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390460.379820:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098048768 00000100:00100000:1.0:1788390460.379827:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098048768 00000100:00100000:1.0:1788390460.379875:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788390460.379885:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6493:x1875263098048768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788390460.380065:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6493:1875263098048768:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788390460.380092:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6493:x1875263098048768:12345-0@lo:1000:mdt00_001.0 Request processed in 140us (446us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788390460.380100:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00010000:3.0:1788390460.380101:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380114:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380122:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380128:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfe00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390460.380132:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380140:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380156:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:3.0:1788390460.380167:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390460.380172:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380178:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be982fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380203:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380209:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380215:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380220:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390460.380223:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380229:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380236:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:3.0:1788390460.380239:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390460.380242:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380247:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98232 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380269:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380292:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244008 expref: 22 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380300:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380350:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244008 expref: 22 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.380363:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244008 expref: 22 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390460.380375:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098048896:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390460.380445:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb0696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390460.386689:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.386771:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb16d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875263098048896:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390460.386798:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.386813:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088576896 00000100:00100000:1.0:1788390460.386821:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088576896 00010000:00010000:1.0:1788390460.386859:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244008 expref: 23 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.386900:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 93 00000100:00100000:1.0:1788390460.386910:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:2405:x1875263088576896:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390460.386934:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390460.386947:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244008 expref: 23 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.386960:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244008 expref: 23 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.386982:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9824e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244008 expref: 23 pid: 12122 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.386996:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:1.0:1788390460.387001:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.387010:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.387018:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.387052:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390460.387083:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387092:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387106:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.387107:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:2405:x1875263088576896:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 196us (424us total) trans 0 rc 0/0 00010000:00010000:3.0:1788390460.387124:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.387125:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 93 00010000:00010000:3.0:1788390460.387140:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387148:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cec00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390460.387152:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387160:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387169:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:3.0:1788390460.387172:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390460.387175:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387181:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98304 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387192:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387198:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387203:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387208:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390460.387210:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387227:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387235:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb7863f00) 00010000:00010000:3.0:1788390460.387237:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788390460.387240:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.387246:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be982f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390460.387746:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12387:x1875263088576512:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 20691us (20836us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788390460.387756:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 200 00000020:00080000:3.0:1788390460.387759:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788390460.387894:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390460.387899:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390460.388538:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788390460.388551:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390460.397418:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390460.397971:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088577152 00000100:00100000:1.0:1788390460.397982:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088577152 00000100:00100000:1.0:1788390460.398045:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00100000:1.0:1788390460.398057:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb604d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12387:x1875263088577152:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788390460.398311:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788390460.398370:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788390460.398410:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.398428:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.398440:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.398449:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.398455:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.398461:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390460.398482:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390460.398502:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390460.398511:0:13157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.398520:0:13157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cf400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390460.398525:0:13157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.398533:0:13157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.398547:0:13157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:3.0:1788390460.398551:0:13157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788390460.398555:0:13157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390460.398572:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be9830b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390460.398581:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb604d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:12387:x1875263088577152:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 524us (1168us total) trans 4294967470 rc 0/0 00010000:00010000:3.0:1788390460.398586:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390460.398590:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390460.398592:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 50 00000020:00080000:1.0:1788390460.398598:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788390460.398658:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390460.561585:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390460.695207:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.695243:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.695283:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.695318:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390460.695376:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088577792 00000100:00100000:1.0:1788390460.695387:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088577792 00000100:00100000:3.0:1788390460.695412:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00080000:3.0:1788390460.695442:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390460.695448:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00100000:1.0:1788390460.695457:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e879b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2407:x1875263088577792:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390460.695458:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088577536 00000100:00100000:3.0:1788390460.695465:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088577536 00000100:00100000:3.0:1788390460.695507:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088578048 00000100:00100000:3.0:1788390460.695511:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088578048 00000100:00100000:3.0:1788390460.695528:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088577408 00000100:00100000:3.0:1788390460.695530:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088577408 00000100:00100000:3.0:1788390460.695545:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 225 00000100:00100000:3.0:1788390460.695552:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088577536:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390460.695592:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088577536:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 40us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.695600:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 225 00000100:00100000:3.0:1788390460.695618:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 226 00000100:00100000:3.0:1788390460.695624:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088578048:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390460.695649:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088578048:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.695664:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 226 00000100:00100000:3.0:1788390460.695677:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 227 00000100:00100000:3.0:1788390460.695684:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:2407:x1875263088577408:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390460.695715:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:2407:x1875263088577408:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.695721:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 227 00000100:00080000:3.0:1788390460.695739:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788390460.696060:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088577280 00000100:00100000:2.0:1788390460.696066:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088577280 00000100:00100000:1.0:1788390460.696071:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e879b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2407:x1875263088577792:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 612us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390460.696080:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00100000:2.0:1788390460.696106:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 367 00000100:00100000:2.0:1788390460.696116:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088577280:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390460.696147:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088577280:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 33us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390460.696154:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 367 00000100:00100000:1.0:1788390460.698757:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390460.698810:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390460.698883:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088577664 00000100:00100000:3.0:1788390460.698892:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088577664 00000100:00100000:3.0:1788390460.698954:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:3.0:1788390460.698964:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2407:x1875263088577664:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390460.699042:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2407:x1875263088577664:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390460.699050:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:2.0:1788390460.699206:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088577920 00000100:00100000:2.0:1788390460.699211:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088577920 00000100:00100000:2.0:1788390460.699261:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 228 00000100:00100000:2.0:1788390460.699270:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088577920:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390460.699313:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088577920:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 45us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390460.699352:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 228 00000100:00080000:3.0:1788390460.699466:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788390460.756857:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788390461.010134:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098049024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390461.010209:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390461.010353:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098049024 00000100:00100000:3.0:1788390461.010361:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098049024 00000100:00100000:3.0:1788390461.010411:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788390461.010422:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098049024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788390461.010453:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788390461.010501:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098049024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390461.010509:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788390461.010619:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098049024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788390461.585558:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390461.814831:0:14723:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390461.814838:0:14723:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390461.814862:0:14723:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:0.0:1788390461.814869:0:14723:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788390461.926391:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390461.926690:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088578304 00000100:00100000:3.0:1788390461.926700:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088578304 00000100:00100000:3.0:1788390461.926786:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 201 00000100:00100000:3.0:1788390461.926797:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:12405:x1875263088578304:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390461.926816:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390461.926836:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be98312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244040 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.926952:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98319 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.926966:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98319 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.926978:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98319 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390461.926988:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788390461.927090:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be98312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244040 expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.927108:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98319 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244040 expref: 25 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.927117:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:3.0:1788390461.927120:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788390461.927123:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cec00, rc 0) 00000100:00100000:3.0:1788390461.929886:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:12405:x1875263088578304:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 380us (793us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788390461.929901:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 201 00000100:00080000:2.0:1788390461.930073:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390461.932701:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390461.932745:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088578432 00000100:00100000:1.0:1788390461.932753:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088578432 00000100:00100000:1.0:1788390461.932800:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 202 00000100:00100000:1.0:1788390461.932810:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:12405:x1875263088578432:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:1.0:1788390461.932881:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.932897:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.932920:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.932936:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.932942:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.932949:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933023:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933044:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933051:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390461.933095:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933106:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933112:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933118:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933124:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cf600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390461.933128:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933135:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933146:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:1.0:1788390461.933149:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390461.933153:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933158:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98327 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933176:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933182:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933187:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933193:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390461.933196:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933202:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933209:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb785f500) 00010000:00010000:1.0:1788390461.933212:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390461.933215:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933220:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be9832e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933235:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933241:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933246:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933257:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390461.933261:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933266:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933274:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984fb785ff00) 00010000:00010000:1.0:1788390461.933276:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390461.933279:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390461.933284:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be98335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390461.933377:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:12405:x1875263088578432:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 567us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390461.933385:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 202 00000100:00100000:1.0:1788390461.961761:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390461.961846:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088578688 00000100:00100000:0.0:1788390461.961855:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088578688 00000100:00100000:0.0:1788390461.962255:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 203 00000100:00100000:0.0:1788390461.962266:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:12408:x1875263088578688:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390461.962289:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390461.962308:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9833c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244047 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962419:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962435:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962446:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962460:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962487:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962494:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962605:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962613:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962621:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390461.962630:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788390461.962704:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962712:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962718:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962723:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390461.962728:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962735:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962756:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390461.962759:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390461.962763:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962769:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98343 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962782:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962788:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962794:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962799:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390461.962802:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962808:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962815:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f89fab600) 00010000:00010000:0.0:1788390461.962818:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390461.962821:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962826:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be9834a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962890:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be9833c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244047 expref: 28 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962903:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244047 expref: 27 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390461.962923:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:0.0:1788390461.962925:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390461.962927:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4a00, rc 0) 00000100:00100000:0.0:1788390461.962984:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12408:x1875263088578688:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 721us (1232us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788390461.962992:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 203 00000100:00100000:1.0:1788390461.967007:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390461.967063:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088578816 00000100:00100000:3.0:1788390461.967096:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088578816 00000100:00100000:3.0:1788390461.967157:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 204 00000100:00100000:3.0:1788390461.967168:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12408:x1875263088578816:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:3.0:1788390461.967239:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.967255:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.967265:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.967293:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.967297:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.967302:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.967305:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390461.967308:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.967313:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.967345:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:3.0:1788390461.967348:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390461.967352:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390461.967364:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9835f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390461.967450:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12408:x1875263088578816:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 285us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390461.967457:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 204 00000100:00100000:1.0:1788390461.972543:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390461.972637:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088579072 00000100:00100000:0.0:1788390461.972648:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088579072 00000100:00100000:0.0:1788390461.972706:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:0.0:1788390461.972717:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12408:x1875263088579072:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:0.0:1788390461.972935:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+28:12408:x1875263088579072:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 219us (400us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788390461.972943:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:0.0:1788390462.010533:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.010662:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088579328 00000100:00100000:1.0:1788390462.010672:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088579328 00000100:00100000:1.0:1788390462.010780:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 205 00000100:00100000:1.0:1788390462.010792:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+28:11930:x1875263088579328:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:1.0:1788390462.010814:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390462.010834:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98366 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24404e expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.010985:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.010999:0:8996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244047 expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.011007:0:8996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.011038:0:8996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244047 expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.011051:0:8996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244047 expref: 29 pid: 6493 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.011064:0:8996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098049152:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390462.011166:0:8996:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390462.015804:0:8996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098049152:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390462.015833:0:8996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.016372:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.016757:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088579456 00000100:00100000:3.0:1788390462.016768:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088579456 00010000:00010000:3.0:1788390462.016810:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244047 expref: 30 pid: 6493 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390462.016878:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 94 00000100:00100000:3.0:1788390462.016887:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:2404:x1875263088579456:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390462.016901:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390462.016916:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244047 expref: 30 pid: 6493 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.016936:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244047 expref: 30 pid: 6493 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.016964:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98351 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244047 expref: 30 pid: 6493 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.016984:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:3.0:1788390462.016989:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.017013:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.017019:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.017244:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390462.017311:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:2404:x1875263088579456:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 425us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390462.017317:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 94 00010000:00010000:2.0:1788390462.020350:0:8996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.020583:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390462.020606:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788390462.020748:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be98366 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24404e expref: 30 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.020785:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24404e expref: 29 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.020795:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:2.0:1788390462.020798:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390462.020802:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5ce000, rc 0) 00000100:00100000:2.0:1788390462.020878:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:11930:x1875263088579328:12345-192.168.202.11@tcp:101:bash.0 Request processed in 10088us (10354us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788390462.020887:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 205 00000100:00100000:1.0:1788390462.025209:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.025301:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088579584 00000100:00100000:0.0:1788390462.025315:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088579584 00000100:00100000:0.0:1788390462.025737:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 206 00000100:00100000:0.0:1788390462.025747:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:11930:x1875263088579584:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:0.0:1788390462.025771:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390462.025806:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9837b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244055 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.025837:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.025851:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.025862:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.025977:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9837b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244055 expref: 31 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.025997:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244055 expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.026005:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:0.0:1788390462.026008:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390462.026011:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:0.0:1788390462.026074:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:11930:x1875263088579584:12345-192.168.202.11@tcp:101:bash.0 Request processed in 329us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.026081:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 206 00000100:00100000:0.0:1788390462.030256:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.030401:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088579840 00000100:00100000:1.0:1788390462.030429:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088579840 00000100:00100000:1.0:1788390462.030512:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 207 00000100:00100000:1.0:1788390462.030524:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:11930:x1875263088579840:12345-192.168.202.11@tcp:36:bash.0 00010000:00010000:1.0:1788390462.030831:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.030853:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.030886:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390462.030954:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788390462.030988:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2746689 reply state 0000000098019457 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.031004:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.031013:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:1.0:1788390462.031017:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788390462.031022:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788390462.031069:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788390462.031364:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+34:11930:x1875263088579840:12345-192.168.202.11@tcp:36:bash.0 Request processed in 840us (1112us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788390462.031373:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 207 00000020:00080000:1.0:1788390462.031380:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788390462.034238:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390462.034314:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088579968 00000100:00100000:2.0:1788390462.034399:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088579968 00000100:00100000:2.0:1788390462.034474:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 208 00000100:00100000:2.0:1788390462.034487:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+34:11930:x1875263088579968:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390462.034515:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390462.034537:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98390 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24405c expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.034601:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24405c expref: 35 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.034619:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24405c expref: 35 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.034643:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:2.0:1788390462.034647:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390462.034669:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba0e00, rc 0) 00000100:00100000:2.0:1788390462.034746:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:11930:x1875263088579968:12345-192.168.202.11@tcp:101:bash.0 Request processed in 262us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390462.034754:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 208 00000100:00100000:2.0:1788390462.038295:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.038512:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088580096 00000100:00100000:1.0:1788390462.038525:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088580096 00000100:00100000:1.0:1788390462.038608:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 66 00000100:00100000:1.0:1788390462.038622:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:11930:x1875263088580096:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:1.0:1788390462.038644:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390462.038667:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244063 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390462.038693:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a98ac3b, atime: 0x6a98ac3a, ctime: 0x6a98ac3b, blocks: 0x8 00010000:00010000:1.0:1788390462.038734:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=282s v=(0 0) 00010000:00010000:1.0:1788390462.038738:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390462.038745:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244063 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.038760:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244063 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.038771:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cfa00, rc 0) 00000100:00100000:1.0:1788390462.038833:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:11930:x1875263088580096:12345-192.168.202.11@tcp:101:bash.0 Request processed in 216us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390462.038838:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 66 00000100:00080000:2.0:1788390462.038893:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390462.040703:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.040782:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088580224 00000100:00100000:1.0:1788390462.040791:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088580224 00002000:00010000:1.0:1788390462.040831:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1788390462.040836:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e88835f80 with x1875263088580224 ext(0->18446744073709551615) 00002000:00010000:1.0:1788390462.040847:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e88835f80. 00000100:00100000:1.0:1788390462.040952:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:1.0:1788390462.040964:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088580224:12345-192.168.202.11@tcp:10:bash.0 00002000:00010000:1.0:1788390462.041484:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788390462.041488:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788390459 -> 1788390461 00002000:00010000:1.0:1788390462.041490:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788390458 -> 1788390458 00002000:00010000:1.0:1788390462.041492:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788390459 -> 1788390461 00002000:00010000:1.0:1788390462.041493:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788390462.041905:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088580224:12345-192.168.202.11@tcp:10:bash.0 Request processed in 939us (1205us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788390462.041940:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 5 00002000:00010000:1.0:1788390462.041946:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1788390462.041949:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e88835f80 with x1875263088580224 ext(0->18446744073709551615) 00002000:00010000:1.0:1788390462.041955:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e88835f80. 00000100:00100000:0.0:1788390462.091472:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.092237:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088580352 00000100:00100000:3.0:1788390462.092253:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088580352 00000100:00100000:3.0:1788390462.092490:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 209 00000100:00100000:3.0:1788390462.092502:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:12422:x1875263088580352:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:3.0:1788390462.092598:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.092618:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.092631:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.092647:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.092654:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.092661:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.092785:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.092795:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.092803:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390462.092984:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.092999:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093006:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093013:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093019:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390462.093024:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093031:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093046:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:3.0:1788390462.093049:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390462.093054:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093068:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be9839e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093084:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093090:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093096:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093101:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390462.093104:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093110:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093118:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb7863e00) 00010000:00010000:3.0:1788390462.093121:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390462.093124:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093129:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be983a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093145:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093152:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093165:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093170:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfe00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390462.093174:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093180:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093188:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:3.0:1788390462.093191:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390462.093194:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.093200:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be983ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390462.093404:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:12422:x1875263088580352:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 902us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390462.093413:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 209 00000100:00100000:2.0:1788390462.129559:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.129639:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088580608 00000100:00100000:1.0:1788390462.129653:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088580608 00000100:00100000:1.0:1788390462.129768:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 210 00000100:00100000:1.0:1788390462.129781:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+35:12425:x1875263088580608:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390462.129807:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390462.129834:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be983b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24406a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.129986:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130002:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130015:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130031:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130037:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130052:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130201:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be983c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130211:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be983c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130218:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be983c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390462.130229:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788390462.130382:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130390:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130398:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130405:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390462.130409:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130418:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130431:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:1.0:1788390462.130434:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390462.130439:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130455:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce600/0xe156d0713be983ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130470:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130475:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130481:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130486:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390462.130488:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130493:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130499:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984fb785fc00) 00010000:00010000:1.0:1788390462.130501:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390462.130503:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130508:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce200/0xe156d0713be983c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130550:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf600/0xe156d0713be983b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24406a expref: 38 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130562:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be983c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24406a expref: 37 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.130574:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:1.0:1788390462.130576:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788390462.130579:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f8a5cf800, rc 0) 00000100:00100000:1.0:1788390462.130652:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:12425:x1875263088580608:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 873us (1108us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788390462.130660:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 210 00000100:00100000:0.0:1788390462.133662:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390462.133736:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088580736 00000100:00100000:2.0:1788390462.133749:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088580736 00000100:00100000:2.0:1788390462.133821:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 211 00000100:00100000:2.0:1788390462.133831:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:12425:x1875263088580736:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:2.0:1788390462.133939:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.133961:0:8996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24404e expref: 37 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.133978:0:8996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.134027:0:8996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24404e expref: 37 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.134042:0:8996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24404e expref: 37 pid: 8996 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390462.134057:0:8996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098049280:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390462.134223:0:8996:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86833780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390462.137822:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.137922:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088580992 00000100:00100000:1.0:1788390462.137935:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088580992 00000100:00100000:1.0:1788390462.138010:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:1.0:1788390462.138024:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:6166:x1875263088580992:12345-192.168.202.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788390462.138446:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:6166:x1875263088580992:12345-192.168.202.11@tcp:35:ldlm_bl.0 Request processed in 424us (637us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788390462.138455:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:2.0:1788390462.138990:0:8996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87949880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8996:1875263098049280:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390462.139024:0:8996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.145280:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.145461:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088581120 00000100:00100000:0.0:1788390462.145492:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088581120 00010000:00010000:0.0:1788390462.145543:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24404e expref: 39 pid: 8996 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390462.145612:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 95 00000100:00100000:0.0:1788390462.145633:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:2405:x1875263088581120:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390462.145656:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390462.145666:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24404e expref: 39 pid: 8996 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.145684:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24404e expref: 39 pid: 8996 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.145720:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5ce000/0xe156d0713be9836d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24404e expref: 39 pid: 8996 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.145743:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:0.0:1788390462.145750:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.145762:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.145770:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.145803:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390462.145870:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:2405:x1875263088581120:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 241us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.145883:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 95 00010000:00010000:2.0:1788390462.146121:0:8996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.146129:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.146179:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.146184:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.146190:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.146195:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390462.146199:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.146204:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.146212:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:2.0:1788390462.146214:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390462.146217:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.146222:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be983d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390462.146279:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:12425:x1875263088580736:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 12449us (12633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390462.146286:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 211 00000100:00100000:1.0:1788390462.148003:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.148142:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088581376 00000100:00100000:0.0:1788390462.148159:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088581376 00000100:00100000:0.0:1788390462.148233:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:0.0:1788390462.148243:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+37:12425:x1875263088581376:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:0.0:1788390462.148512:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:12425:x1875263088581376:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 270us (516us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788390462.148518:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:3.0:1788390462.196138:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.196410:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088581632 00000100:00100000:0.0:1788390462.196433:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088581632 00000100:00100000:0.0:1788390462.196512:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 212 00000100:00100000:0.0:1788390462.196525:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+38:12436:x1875263088581632:12345-192.168.202.11@tcp:101:cat.0 00010000:00010000:0.0:1788390462.196554:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390462.196584:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be983dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244071 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.196682:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.196701:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.196716:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.196734:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.196764:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.196772:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.196927:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be983f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.196939:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be983f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.196946:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be983f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390462.196957:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788390462.197069:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197078:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197086:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197091:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390462.197095:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197103:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197128:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390462.197132:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390462.197137:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197154:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be983e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197173:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197179:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197185:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197190:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390462.197193:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197199:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197207:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f89fab600) 00010000:00010000:0.0:1788390462.197209:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390462.197212:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197217:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be983eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197281:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be983dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244071 expref: 41 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197297:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be983f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244071 expref: 40 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.197305:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:0.0:1788390462.197308:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390462.197310:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4a00, rc 0) 00000100:00100000:0.0:1788390462.197453:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+40:12436:x1875263088581632:12345-192.168.202.11@tcp:101:cat.0 Request processed in 930us (1330us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788390462.197461:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 212 00000100:00100000:3.0:1788390462.201864:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.201986:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088581888 00000100:00100000:0.0:1788390462.201999:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088581888 00000100:00100000:0.0:1788390462.202079:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 54 00000100:00100000:0.0:1788390462.202093:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+40:12436:x1875263088581888:12345-192.168.202.11@tcp:35:cat.0 00000100:00100000:0.0:1788390462.202496:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+41:12436:x1875263088581888:12345-192.168.202.11@tcp:35:cat.0 Request processed in 407us (647us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788390462.202502:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 54 00000100:00100000:1.0:1788390462.221765:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.222860:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088582144 00000100:00100000:0.0:1788390462.222877:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088582144 00000100:00100000:0.0:1788390462.223004:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 213 00000100:00100000:0.0:1788390462.223017:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+41:12437:x1875263088582144:12345-192.168.202.11@tcp:36:rm.0 00010000:00010000:0.0:1788390462.223093:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788390462.223126:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98390 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24405c expref: 41 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223173:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be983f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244071 expref: 40 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223187:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf800/0xe156d0713be983c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24406a expref: 39 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223200:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244055 expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223210:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:0.0:1788390462.223215:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390462.223238:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223252:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223262:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223276:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223283:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223289:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223701:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223712:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.223719:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390462.224002:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788390462.224014:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 282781691707ns, next at 283781688597ns, rc = 0 00010000:00010000:0.0:1788390462.224070:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224079:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224087:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224094:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224101:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224107:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224135:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390462.224158:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224174:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224181:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224187:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390462.224193:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224201:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224212:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:0.0:1788390462.224215:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788390462.224219:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224226:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9840e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224244:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224251:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224257:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224262:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390462.224273:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224279:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224288:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390462.224291:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390462.224294:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224301:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98400 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390462.224311:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cab36cc reply state 00000000701d8490 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224370:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.224377:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f89fab600) 00010000:00010000:0.0:1788390462.224379:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788390462.224383:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390462.225467:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:12437:x1875263088582144:12345-192.168.202.11@tcp:36:rm.0 Request processed in 2442us (3705us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788390462.225479:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 213 00010000:00010000:2.0:1788390462.225624:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390462.225634:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.225644:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5000 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390462.225650:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.225660:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.225677:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:2.0:1788390462.225681:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788390462.225686:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.225692:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98415 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.225711:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390462.225713:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390462.225715:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390462.263634:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390462.264210:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088582400 00000100:00100000:2.0:1788390462.264226:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088582400 00000100:00100000:2.0:1788390462.264306:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 214 00000100:00100000:2.0:1788390462.264318:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+39:12443:x1875263088582400:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390462.264627:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390462.264656:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be9841c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244078 expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.264793:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.264812:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.264826:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.264843:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.264851:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.264859:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390462.266581:0:8996:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788390462.266796:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.266814:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.266827:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.266900:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.266919:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.266927:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.266941:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390462.266947:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.266956:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.266973:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:2.0:1788390462.266976:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390462.266982:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.266990:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be98423 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390462.267007:0:8996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074c27279 reply state 00000000dfac6afd transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.267513:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.267521:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f89fab600) 00010000:00010000:2.0:1788390462.267532:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390462.267537:0:8996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788390462.267587:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1c00/0xe156d0713be9841c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244078 expref: 42 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.267606:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244078 expref: 41 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.267614:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984f8379b600) 00010000:00010000:2.0:1788390462.267616:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390462.267619:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1200, rc 0) 00000100:00100000:2.0:1788390462.267719:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+42:12443:x1875263088582400:12345-192.168.202.11@tcp:101:bash.0 Request processed in 3402us (4097us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788390462.267730:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 214 00000100:00100000:0.0:1788390462.272534:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.272764:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088582528 00000100:00100000:1.0:1788390462.272777:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088582528 00000100:00100000:1.0:1788390462.272872:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00100000:1.0:1788390462.272887:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088582528:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:1.0:1788390462.272920:0:8798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390462.272949:0:8798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24407f expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390462.272984:0:8798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390462.273042:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=282s v=(0 0) 00010000:00010000:1.0:1788390462.273048:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390462.273061:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24407f expref: 8 pid: 8798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.273087:0:8798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24407f expref: 8 pid: 8798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.273105:0:8798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4400, rc 0) 00000100:00100000:1.0:1788390462.273173:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088582528:12345-192.168.202.11@tcp:101:bash.0 Request processed in 291us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390462.273182:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00080000:3.0:1788390462.273419:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390462.277829:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.280829:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088582656 00000100:00100000:3.0:1788390462.280854:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088582656 00000100:00100000:3.0:1788390462.281161:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:3.0:1788390462.281187:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:12443:x1875263088582656:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390462.281235:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390462.281262:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244086 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.281310:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24407f expref: 9 pid: 8798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.281338:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390462.281526:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390462.281536:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.281585:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24407f expref: 9 pid: 8798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.281603:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24407f expref: 9 pid: 8798 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390462.281620:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8409:1875263098049408:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390462.281752:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390462.286972:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8409:1875263098049408:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390462.287024:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.287063:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20ce200, rc 0) 00000100:00100000:3.0:1788390462.287278:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:12443:x1875263088582656:12345-192.168.202.11@tcp:101:bash.0 Request processed in 6094us (9462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390462.287289:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:2.0:1788390462.287439:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.287791:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088582784 00000100:00100000:3.0:1788390462.287800:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088582784 00010000:00010000:3.0:1788390462.287833:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24407f expref: 9 pid: 8798 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390462.287916:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 96 00000100:00100000:3.0:1788390462.287927:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088582784:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390462.287947:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390462.287977:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24407f expref: 9 pid: 8798 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.287993:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24407f expref: 9 pid: 8798 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.288022:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be9843f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24407f expref: 9 pid: 8798 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.288049:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390462.288056:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390462.288066:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.288078:0:10369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.288126:0:10369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390462.288140:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10369:1875263098049536:192.168.202.11@tcp:105: 00000100:00100000:3.0:1788390462.288221:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069780 going to sleep for 11 seconds 00000100:00100000:2.0:1788390462.293832:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.294199:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088583040 00000100:00100000:0.0:1788390462.294212:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088583040 00000100:00100000:0.0:1788390462.294282:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 55 00000100:00100000:0.0:1788390462.294295:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+42:12443:x1875263088583040:12345-192.168.202.11@tcp:35:bash.0 00000100:00100000:0.0:1788390462.294748:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:12443:x1875263088583040:12345-192.168.202.11@tcp:35:bash.0 Request processed in 454us (932us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788390462.294758:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 55 00000100:00100000:3.0:1788390462.295058:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10369:1875263098049536:192.168.202.11@tcp:105: 00010000:00010000:3.0:1788390462.295089:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390462.295129:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088582784:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 7203us (7691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390462.295139:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 96 00000100:00100000:2.0:1788390462.445620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.445737:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088583168 00000100:00100000:0.0:1788390462.445751:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088583168 00000100:00100000:0.0:1788390462.445831:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 215 00000100:00100000:0.0:1788390462.445844:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+43:12459:x1875263088583168:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390462.445876:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390462.445901:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9844d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24408d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.445998:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.446016:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.446033:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390462.446102:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788390462.446107:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390462.446131:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.446162:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9844d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24408d expref: 45 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.446198:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24408d expref: 44 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.446228:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390462.446232:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390462.446237:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:0.0:1788390462.446317:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+44:12459:x1875263088583168:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 475us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.446386:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 215 00000100:00100000:2.0:1788390462.453265:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.453350:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088583424 00000100:00100000:0.0:1788390462.453364:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088583424 00000100:00100000:0.0:1788390462.453443:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 216 00000100:00100000:0.0:1788390462.453457:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+44:12459:x1875263088583424:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390462.453483:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390462.453525:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9845b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244094 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.453657:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.453670:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.453680:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390462.453690:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788390462.453809:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9845b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244094 expref: 47 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.453846:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244094 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.453853:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984f8379b600) 00010000:00010000:0.0:1788390462.453856:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390462.453859:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4a00, rc 0) 00000100:00100000:0.0:1788390462.453933:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+46:12459:x1875263088583424:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 480us (681us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788390462.453944:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 216 00000100:00100000:2.0:1788390462.459011:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.459153:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088583680 00000100:00100000:1.0:1788390462.459168:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088583680 00000100:00100000:1.0:1788390462.459242:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 217 00000100:00100000:1.0:1788390462.459254:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+46:12459:x1875263088583680:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390462.459287:0:8996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390462.459316:0:8996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98470 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24409b expref: -99 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.459484:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98477 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.459515:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.459530:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390462.459563:0:8996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788390462.459706:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98470 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24409b expref: 49 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.459727:0:8996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98477 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24409b expref: 48 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.459737:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984f8379b600) 00010000:00010000:1.0:1788390462.459740:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788390462.459745:0:8996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5e00, rc 0) 00000100:00100000:1.0:1788390462.460002:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+48:12459:x1875263088583680:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 749us (1008us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788390462.460010:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 217 00000100:00100000:2.0:1788390462.461050:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.461176:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088583808 00000100:00100000:1.0:1788390462.461185:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088583808 00000100:00100000:1.0:1788390462.461249:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:1.0:1788390462.461260:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+48:2406:x1875263088583808:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390462.461275:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390462.461298:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244094 expref: 48 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.461316:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984f8379b600) 00010000:00010000:1.0:1788390462.461342:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390462.461429:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+47:2406:x1875263088583808:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 170us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390462.461437:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:2.0:1788390462.468808:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.469004:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088583936 00000100:00100000:1.0:1788390462.469018:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088583936 00000100:00100000:1.0:1788390462.469077:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 69 00000100:00100000:1.0:1788390462.469089:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088583936:12345-192.168.202.11@tcp:1:lfs.0 00010000:00010000:1.0:1788390462.469148:0:8798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.469172:0:8798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.469182:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788390462.469187:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390462.469192:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.469235:0:8798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.469251:0:8798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 8 pid: 8409 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.469266:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88823800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8798:1875263098049664:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390462.469415:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390462.472704:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.472859:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88823800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8798:1875263098049664:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390462.472896:0:8798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390462.473477:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088584064 00000100:00100000:0.0:1788390462.473488:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088584064 00002000:00100000:0.0:1788390462.473594:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff984e8825ce00 x1875263088584064/t0(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:78/0 lens 504/0 e 0 to 0 dl 1788390473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390462.473604:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e8825ce00 with x1875263088584064 ext(0->8) 00010000:00010000:0.0:1788390462.473614:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 9 pid: 8409 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.473630:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 9 pid: 8409 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390462.473638:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff984e8825ce00 00000100:00100000:0.0:1788390462.473715:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:0.0:1788390462.473726:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2404:x1875263088584064:12345-192.168.202.11@tcp:4:lfs.0 00000100:00100000:0.0:1788390462.476534:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2404:x1875263088584064:12345-192.168.202.11@tcp:4:lfs.0 Request processed in 2791us (3827us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788390462.476569:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 3 00002000:00100000:0.0:1788390462.476586:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff984e8825ce00 x1875263088584064/t4294967309(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:78/0 lens 504/448 e 0 to 0 dl 1788390473 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390462.476599:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e8825ce00 with x1875263088584064 ext(0->8) 00010000:00010000:0.0:1788390462.476611:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 11 pid: 8409 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.476634:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 11 pid: 8409 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390462.476643:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff984e8825ce00 00000100:00100000:2.0:1788390462.483828:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.483970:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088584192 00000100:00100000:1.0:1788390462.483982:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088584192 00010000:00010000:1.0:1788390462.484035:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 11 pid: 8409 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.484135:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 97 00000100:00100000:1.0:1788390462.484147:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2406:x1875263088584192:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390462.484180:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788390462.484204:0:6478:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788390462.484208:0:6478:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788390462 00002000:00010000:1.0:1788390462.484211:0:6478:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788390462 00002000:00010000:1.0:1788390462.484213:0:6478:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788390462 00002000:00010000:1.0:1788390462.484216:0:6478:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788390462.484223:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 11 pid: 8409 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.484241:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 11 pid: 8409 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.484273:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e134b78c/0xe156d0713be98446 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244086 expref: 11 pid: 8409 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.484295:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390462.484300:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390462.484308:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.484419:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.484461:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390462.484529:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2406:x1875263088584192:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 384us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390462.484537:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 97 00010000:00010000:2.0:1788390462.484606:0:8798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.484618:0:8798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.484655:0:8798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.484664:0:8798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.484674:0:8798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.484681:0:8798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390462.484685:0:8798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.484694:0:8798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.484707:0:8798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.484716:0:8798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c9fa3a5/0xe156d0713be98485 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390462.485835:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088583936:12345-192.168.202.11@tcp:1:lfs.0 Request processed in 16740us (17033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390462.485848:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 69 00000100:00100000:2.0:1788390462.488890:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.489098:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088584448 00000100:00100000:0.0:1788390462.489111:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088584448 00000100:00100000:0.0:1788390462.489191:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 56 00000100:00100000:0.0:1788390462.489203:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb604e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+47:12459:x1875263088584448:12345-192.168.202.11@tcp:35:lfs.0 00000004:00010000:0.0:1788390462.489289:0:14240:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98477 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24409b expref: 47 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390462.489575:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788390462.489612:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788390462.489987:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788390462.490038:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.490056:0:14240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244078 expref: 51 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.490090:0:14240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.490137:0:14240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244078 expref: 51 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.490154:0:14240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244078 expref: 51 pid: 8996 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390462.490174:0:14240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88836a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14240:1875263098049792:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390462.490293:0:14240:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982de3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390462.494180:0:14240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88836a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14240:1875263098049792:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390462.494222:0:14240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390462.494436:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.494512:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088584576 00000100:00100000:0.0:1788390462.494522:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088584576 00010000:00010000:0.0:1788390462.494569:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244078 expref: 52 pid: 8996 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390462.494619:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 98 00000100:00100000:0.0:1788390462.494632:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+52:2405:x1875263088584576:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390462.494650:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390462.494658:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244078 expref: 52 pid: 8996 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.494696:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244078 expref: 52 pid: 8996 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.494723:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1200/0xe156d0713be98431 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244078 expref: 52 pid: 8996 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.494743:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984f8379b600) 00010000:00010000:0.0:1788390462.494750:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.494761:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.494770:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.494803:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390462.494872:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+51:2405:x1875263088584576:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 243us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.494880:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 98 00010000:00010000:3.0:1788390462.494951:0:14240:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.494958:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390462.495111:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1788390462.495466:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788390462.495581:0:14240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14240:1875263098049920:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1788390462.495653:0:14240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390462.495686:0:14240:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390462.497037:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098049920 00000100:00100000:0.0:1788390462.497055:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098049920 00000100:00100000:0.0:1788390462.497135:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788390462.497148:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14240:x1875263098049920:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788390462.497294:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14240:x1875263098049920:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 149us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.497303:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788390462.497547:0:14240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14240:1875263098049920:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788390462.497731:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788390462.497815:0:14240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8825c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14240:1875263098050048:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788390462.497863:0:14240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390462.497897:0:14240:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86833cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390462.497971:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098050048 00000100:00100000:1.0:1788390462.497976:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098050048 00000100:00100000:1.0:1788390462.498012:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788390462.498021:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14240:x1875263098050048:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788390462.498157:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14240:x1875263098050048:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 137us (294us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788390462.498165:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788390462.498410:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390462.498415:0:14240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8825c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14240:1875263098050048:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788390462.498465:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788390462.498503:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.498515:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.498524:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.498531:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390462.498536:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.498545:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.498565:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984f8379b600) 00010000:00010000:2.0:1788390462.498568:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788390462.498574:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390462.498597:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be9848c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788390462.498711:0:14240:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788390462.498787:0:14240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788390462.498800:0:14240:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 283056478627ns, next at 284056475963ns, rc = 0 00000001:00080000:2.0:1788390462.498807:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788390462.498830:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984f8379b600) 00010000:00010000:2.0:1788390462.498833:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788390462.498841:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98477 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24409b expref: 55 pid: 8996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390462.498971:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb604e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:12459:x1875263088584448:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 9770us (10094us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788390462.498980:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 56 00000020:00080000:2.0:1788390462.498985:0:14240:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788390462.503296:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.503817:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088584704 00000100:00100000:1.0:1788390462.503831:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088584704 00000100:00100000:1.0:1788390462.503916:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 218 00000100:00100000:1.0:1788390462.503929:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+54:12459:x1875263088584704:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390462.503962:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390462.503994:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be98493 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440a2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.504073:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be98493 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a2 expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.504115:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be98493 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a2 expref: 55 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.504140:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390462.504144:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390462.504149:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5a00, rc 0) 00000100:00100000:1.0:1788390462.504233:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+55:12459:x1875263088584704:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 306us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390462.504241:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 218 00000100:00100000:1.0:1788390462.514067:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.514302:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088584960 00000100:00100000:0.0:1788390462.514316:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088584960 00000100:00100000:0.0:1788390462.514431:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 57 00000100:00100000:0.0:1788390462.514443:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+55:12459:x1875263088584960:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:0.0:1788390462.514749:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+56:12459:x1875263088584960:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 307us (696us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788390462.514757:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 57 00000100:00100000:2.0:1788390462.590556:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.590726:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088585088 00000100:00100000:3.0:1788390462.590740:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088585088 00000100:00100000:3.0:1788390462.590870:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 219 00000100:00100000:3.0:1788390462.590882:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+56:12469:x1875263088585088:12345-192.168.202.11@tcp:34:lfs.0 00010000:00010000:3.0:1788390462.591040:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591072:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591087:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591101:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591110:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591116:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591214:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591224:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591231:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390462.591308:0:12122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591376:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591395:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591403:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591420:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfe00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390462.591426:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591435:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591452:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:3.0:1788390462.591456:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390462.591462:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591468:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9849a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591485:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591492:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591498:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591504:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390462.591514:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591521:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591530:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f89fab600) 00010000:00010000:3.0:1788390462.591533:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390462.591536:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591542:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591554:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591561:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591567:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591572:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cee00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390462.591575:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591581:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591588:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:3.0:1788390462.591590:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390462.591599:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.591605:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390462.591702:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+56:12469:x1875263088585088:12345-192.168.202.11@tcp:34:lfs.0 Request processed in 821us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390462.591712:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 219 00010000:00010000:3.0:1788390462.609582:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390462.621210:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.622227:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088585344 00000100:00100000:0.0:1788390462.622244:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088585344 00000100:00100000:0.0:1788390462.622351:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 220 00000100:00100000:0.0:1788390462.622364:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+56:12472:x1875263088585344:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390462.622393:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390462.622422:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440a9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.622521:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.622539:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.622553:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.622566:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.622573:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.622603:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.622748:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.622756:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.622763:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390462.622774:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788390462.623212:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623221:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623228:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623234:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390462.623239:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623248:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623263:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390462.623266:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390462.623409:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623417:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be984b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623435:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623441:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623447:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623452:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390462.623455:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623461:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623470:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f89fab600) 00010000:00010000:0.0:1788390462.623473:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390462.623476:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623482:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623528:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a9 expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623559:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a9 expref: 58 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.623567:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390462.623570:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390462.623573:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4800, rc 0) 00000100:00100000:0.0:1788390462.623730:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:12472:x1875263088585344:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 1367us (2535us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788390462.623738:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 220 00000100:00100000:2.0:1788390462.627142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.627660:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088585472 00000100:00100000:0.0:1788390462.627674:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088585472 00000100:00100000:0.0:1788390462.627775:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 221 00000100:00100000:0.0:1788390462.627787:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:12472:x1875263088585472:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:0.0:1788390462.627877:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.627893:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.627914:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.627952:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.627958:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.627981:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.627986:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390462.627990:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.627996:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.628008:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390462.628011:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390462.628014:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.628019:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390462.628118:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:12472:x1875263088585472:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 333us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.628126:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 221 00000100:00100000:2.0:1788390462.630603:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.630684:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088585728 00000100:00100000:3.0:1788390462.630695:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088585728 00000100:00100000:3.0:1788390462.630794:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 58 00000100:00100000:3.0:1788390462.630804:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+58:12472:x1875263088585728:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390462.631188:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:12472:x1875263088585728:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 385us (666us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788390462.631195:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 58 00000100:00100000:2.0:1788390462.696441:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.696502:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088585984 00000100:00100000:3.0:1788390462.696514:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088585984 00000100:00100000:3.0:1788390462.696643:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 222 00000100:00100000:3.0:1788390462.696656:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:12482:x1875263088585984:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390462.696688:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390462.696692:0:12122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788390462.697004:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24408d expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.697030:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:3.0:1788390462.697036:0:12122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390462.697085:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984d9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440b0 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.697210:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.697223:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a9 expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.697233:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.697276:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a9 expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.697291:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a9 expref: 59 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390462.697306:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88376a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098050176:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390462.697478:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb0693c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390462.699934:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88376a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098050176:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390462.699937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00010000:00010000:3.0:1788390462.699967:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.700408:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088586112 00000100:00100000:1.0:1788390462.700418:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088586112 00010000:00010000:1.0:1788390462.700465:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a9 expref: 60 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.700502:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 99 00000100:00100000:1.0:1788390462.700513:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:2405:x1875263088586112:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390462.700530:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390462.700537:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a9 expref: 60 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.700561:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a9 expref: 60 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.700587:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be984c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a9 expref: 60 pid: 6493 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.700624:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390462.700628:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.700635:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.700641:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.700661:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390462.700680:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.700687:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.700812:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:2405:x1875263088586112:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 299us (875us total) trans 0 rc 0/0 00000004:00200000:3.0:1788390462.700819:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:1.0:1788390462.700820:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 99 00010000:00010000:3.0:1788390462.701301:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be984d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b0 expref: 60 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.701315:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b0 expref: 59 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.701352:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:3.0:1788390462.701355:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788390462.701358:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20ce400, rc 0) 00000100:00100000:3.0:1788390462.701404:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:12482:x1875263088585984:12345-192.168.202.11@tcp:101:bash.0 Request processed in 4750us (5081us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788390462.701412:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 222 00000100:00100000:2.0:1788390462.703898:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.703974:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088586240 00000100:00100000:0.0:1788390462.703987:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088586240 00000100:00100000:0.0:1788390462.704044:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 223 00000100:00100000:0.0:1788390462.704056:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+59:12482:x1875263088586240:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:0.0:1788390462.704214:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390462.704239:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440b7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.704301:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.704314:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.704349:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.704487:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be984ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b7 expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.704507:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b7 expref: 60 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.704514:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390462.704517:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390462.704520:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5200, rc 0) 00000100:00100000:0.0:1788390462.704600:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:12482:x1875263088586240:12345-192.168.202.11@tcp:101:bash.0 Request processed in 545us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.704607:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 223 00000100:00100000:2.0:1788390462.707135:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.707184:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088586496 00000100:00100000:0.0:1788390462.707196:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088586496 00000100:00100000:0.0:1788390462.707278:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 224 00000100:00100000:0.0:1788390462.707289:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+60:12482:x1875263088586496:12345-192.168.202.11@tcp:36:bash.0 00010000:00010000:0.0:1788390462.707840:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.707873:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.707884:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390462.707940:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788390462.707959:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000716b58ea reply state 00000000a8587dc5 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.707969:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.707975:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390462.707977:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788390462.707980:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390462.708085:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:12482:x1875263088586496:12345-192.168.202.11@tcp:36:bash.0 Request processed in 797us (957us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788390462.708092:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 224 00000020:00080000:0.0:1788390462.708098:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788390462.710116:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.710218:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088586624 00000100:00100000:3.0:1788390462.710230:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088586624 00000100:00100000:3.0:1788390462.710296:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 225 00000100:00100000:3.0:1788390462.710307:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:12482:x1875263088586624:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390462.710357:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390462.710381:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440be expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.710488:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.710500:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b0 expref: 64 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.710526:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.710569:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b0 expref: 64 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.710586:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b0 expref: 64 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390462.710604:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88376a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098050304:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390462.710690:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb0693c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390462.712974:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88376a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098050304:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390462.713009:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390462.713130:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.713358:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088586752 00000100:00100000:0.0:1788390462.713367:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088586752 00010000:00010000:0.0:1788390462.713418:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b0 expref: 65 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390462.713453:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 100 00000100:00100000:0.0:1788390462.713463:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:2404:x1875263088586752:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390462.713479:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390462.713487:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b0 expref: 65 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.713505:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b0 expref: 65 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.713529:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce400/0xe156d0713be984e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b0 expref: 65 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.713547:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390462.713552:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.713564:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.713572:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.713602:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390462.713625:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.713633:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390462.713668:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+64:2404:x1875263088586752:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 206us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.713676:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 100 00000004:00200000:3.0:1788390462.713695:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788390462.713701:0:12122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390462.713844:0:12122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.713879:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440be expref: 64 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.713920:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440be expref: 63 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.713928:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:3.0:1788390462.713932:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390462.713934:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf000, rc 0) 00000100:00100000:3.0:1788390462.714013:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:12482:x1875263088586624:12345-192.168.202.11@tcp:101:bash.0 Request processed in 3708us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390462.714021:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 225 00000100:00100000:2.0:1788390462.716602:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.716679:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088587008 00000100:00100000:0.0:1788390462.716691:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088587008 00000100:00100000:0.0:1788390462.716756:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:0.0:1788390462.716768:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+63:12482:x1875263088587008:12345-192.168.202.11@tcp:35:bash.0 00000100:00100000:0.0:1788390462.717065:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+64:12482:x1875263088587008:12345-192.168.202.11@tcp:35:bash.0 Request processed in 299us (474us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788390462.717074:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:2.0:1788390462.753855:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.753949:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088587136 00000100:00100000:0.0:1788390462.753962:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088587136 00000100:00100000:0.0:1788390462.754044:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 226 00000100:00100000:0.0:1788390462.754057:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+64:12488:x1875263088587136:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390462.754095:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390462.754124:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440c5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.754267:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98518 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.754284:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.754311:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390462.754416:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788390462.754421:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390462.754446:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.754476:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440c5 expref: 66 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.754502:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440c5 expref: 65 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.754525:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390462.754530:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390462.754543:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4600, rc 0) 00000100:00100000:0.0:1788390462.755083:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:12488:x1875263088587136:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 1026us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.755092:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 226 00000100:00100000:2.0:1788390462.758542:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.758596:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088587264 00000100:00100000:0.0:1788390462.758610:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088587264 00000100:00100000:0.0:1788390462.758753:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 227 00000100:00100000:0.0:1788390462.758768:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:12488:x1875263088587264:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390462.758802:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390462.758841:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9851f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440cc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.758940:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.758958:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.758973:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.758996:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759004:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759011:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759103:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98534 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759133:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759141:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390462.759201:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788390462.759207:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390462.759232:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759246:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759255:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759263:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759287:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759294:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390462.759299:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759308:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759372:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390462.759376:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390462.759389:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759396:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98526 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759417:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759424:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759430:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759436:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390462.759439:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759445:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759453:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f89fab600) 00010000:00010000:0.0:1788390462.759456:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390462.759458:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759464:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be9852d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759503:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be9851f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440cc expref: 67 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759533:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440cc expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.759542:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390462.759545:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390462.759548:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:0.0:1788390462.759629:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12488:x1875263088587264:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 864us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.759638:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 227 00000100:00100000:2.0:1788390462.762556:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.762739:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088587392 00000100:00100000:3.0:1788390462.762753:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088587392 00000100:00100000:3.0:1788390462.762898:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:3.0:1788390462.762922:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:2405:x1875263088587392:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390462.762942:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390462.762976:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98534 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440cc expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.763184:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:3.0:1788390462.763191:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390462.763634:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:2405:x1875263088587392:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 715us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390462.763644:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:2.0:1788390462.763856:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.764050:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088587648 00000100:00100000:3.0:1788390462.764057:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088587648 00000100:00100000:3.0:1788390462.764103:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 228 00000100:00100000:3.0:1788390462.764139:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:12488:x1875263088587648:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390462.764166:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390462.764187:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9853b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440d3 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.764371:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.764388:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440be expref: 66 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.764398:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.764439:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440be expref: 66 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.764457:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440be expref: 66 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390462.764474:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88376a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098050432:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390462.764546:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390462.766517:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390462.766530:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88376a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098050432:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390462.766561:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.766612:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088587776 00000100:00100000:1.0:1788390462.766621:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088587776 00010000:00010000:1.0:1788390462.766663:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440be expref: 67 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390462.766718:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 101 00000100:00100000:1.0:1788390462.766726:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:2405:x1875263088587776:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390462.766739:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390462.766744:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440be expref: 67 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.766754:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440be expref: 67 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.766795:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be9850a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440be expref: 67 pid: 12122 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.766808:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390462.766812:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.766821:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.766826:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.766845:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390462.766867:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.766885:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390462.766918:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:1.0:1788390462.766919:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:2405:x1875263088587776:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 193us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390462.766928:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 101 00010000:00010000:3.0:1788390462.767086:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be9853b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440d3 expref: 67 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.767102:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440d3 expref: 66 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390462.767111:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:3.0:1788390462.767113:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788390462.767116:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cee00, rc 0) 00000100:00100000:3.0:1788390462.767158:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12488:x1875263088587648:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 3020us (3302us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788390462.767165:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 228 00000100:00100000:0.0:1788390462.768870:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390462.768944:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088588032 00000100:00100000:1.0:1788390462.768956:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088588032 00000100:00100000:1.0:1788390462.769020:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:1.0:1788390462.769030:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12488:x1875263088588032:12345-192.168.202.11@tcp:103:lfs.0 00010000:00010000:1.0:1788390462.769048:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390462.769073:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be98493 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440a2 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390462.769094:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390462.769100:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390462.769197:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:12488:x1875263088588032:12345-192.168.202.11@tcp:103:lfs.0 Request processed in 168us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390462.769203:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:2.0:1788390462.772232:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.772391:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088588160 00000100:00100000:0.0:1788390462.772414:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088588160 00000100:00100000:0.0:1788390462.772490:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 229 00000100:00100000:0.0:1788390462.772501:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8794ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:12488:x1875263088588160:12345-192.168.202.11@tcp:58:lfs.0 00010000:00010000:0.0:1788390462.772650:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.772670:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.772683:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390462.772812:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788390462.773472:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8794ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:12488:x1875263088588160:12345-192.168.202.11@tcp:58:lfs.0 Request processed in 970us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.773506:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 229 00000100:00100000:2.0:1788390462.775960:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390462.776070:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088588288 00000100:00100000:0.0:1788390462.776084:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088588288 00000100:00100000:0.0:1788390462.776163:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 230 00000100:00100000:0.0:1788390462.776176:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+65:12488:x1875263088588288:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390462.776201:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390462.776228:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440da expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.776551:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.776565:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440da expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.776590:0:6494:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.776606:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440da expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.776622:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390462.776626:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390462.776630:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440da expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390462.776639:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4800, rc 0) 00000100:00100000:0.0:1788390462.776774:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12488:x1875263088588288:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 600us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390462.776782:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 230 00000100:00100000:1.0:1788390463.057664:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390463.057699:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098050560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390463.057885:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390463.058047:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390463.058058:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098050688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390463.058092:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390463.058131:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098050688 00000100:00100000:1.0:1788390463.058141:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098050688 00000100:00100000:1.0:1788390463.058220:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788390463.058232:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875263098050688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390463.058271:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788390463.058360:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875263098050688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390463.058369:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788390463.058528:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390463.058539:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098050816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788390463.058574:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390463.058659:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098050816 00000100:00100000:0.0:1788390463.058664:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098050816 00000100:00100000:0.0:1788390463.058696:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788390463.058703:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098050816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788390463.058715:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788390463.058830:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098050816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390463.058837:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788390463.058871:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390463.059644:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098050560 00000100:00100000:1.0:1788390463.059654:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098050560 00000100:00100000:1.0:1788390463.059695:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788390463.059704:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098050560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788390463.059740:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788390463.059866:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098050560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390463.059873:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788390463.059921:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098050560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788390463.060599:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098050816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390463.060679:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098050688:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788390463.443052:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390463.443064:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390463.443882:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 4 00000040:00080000:0.0:1788390463.443907:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390463.444152:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098050944:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390463.444343:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982de180 going to sleep for 11 seconds 00000100:00100000:0.0:1788390463.448974:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098050944:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390463.454069:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.454246:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088588416 00000100:00100000:3.0:1788390463.454261:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088588416 00000100:00100000:3.0:1788390463.454408:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 231 00000100:00100000:3.0:1788390463.454422:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12489:x1875263088588416:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000100:00080000:0.0:1788390463.454423:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:3.0:1788390463.455736:0:12122:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390463.455937:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12489:x1875263088588416:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 1514us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.455949:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 231 00000100:00100000:2.0:1788390463.470145:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390463.471169:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088588544 00000100:00100000:0.0:1788390463.471185:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088588544 00000100:00100000:0.0:1788390463.471281:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 232 00000100:00100000:0.0:1788390463.471296:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12489:x1875263088588544:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788390463.471760:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.471804:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.471822:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473252:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473278:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473290:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473347:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473357:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473364:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390463.473520:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788390463.473525:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390463.473541:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473554:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473581:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473588:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473593:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390463.473598:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473606:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473620:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:0.0:1788390463.473622:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390463.473628:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473634:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be9855e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473653:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473659:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473665:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473670:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390463.473679:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473685:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473693:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff984f89fabe00) 00010000:00010000:0.0:1788390463.473695:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390463.473698:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473704:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5000/0xe156d0713be98565 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473720:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473727:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473732:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473737:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390463.473739:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473745:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473752:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390463.473753:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390463.473762:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.473768:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be9856c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.473873:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12489:x1875263088588544:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 Request processed in 2576us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390463.473883:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 232 00000100:00100000:2.0:1788390463.477404:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390463.477984:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088588800 00000100:00100000:0.0:1788390463.478008:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088588800 00000100:00100000:0.0:1788390463.478098:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 233 00000100:00100000:0.0:1788390463.478109:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+66:12489:x1875263088588800:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390463.478131:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390463.478158:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98573 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440e1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478269:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478284:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478296:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390463.478307:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788390463.478421:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478428:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478448:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478454:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390463.478459:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478467:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478480:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390463.478483:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788390463.478487:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478494:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9857a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478533:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98573 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440e1 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478543:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:0.0:1788390463.478546:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390463.478549:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98573 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440e1 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.478559:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80a00, rc 0) 00000100:00100000:0.0:1788390463.478626:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:12489:x1875263088588800:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 520us (1240us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788390463.478641:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 233 00000100:00100000:2.0:1788390463.483699:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.483835:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088588928 00000100:00100000:3.0:1788390463.483848:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088588928 00000100:00100000:3.0:1788390463.483937:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 234 00000100:00100000:3.0:1788390463.483952:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:12489:x1875263088588928:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390463.484691:0:12122:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390463.484907:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:12489:x1875263088588928:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 958us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.484918:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 234 00000100:00100000:2.0:1788390463.493111:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390463.494512:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088589184 00000100:00100000:0.0:1788390463.494528:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088589184 00000100:00100000:0.0:1788390463.494601:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 235 00000100:00100000:0.0:1788390463.494613:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:12489:x1875263088589184:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390463.494636:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390463.494640:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788390463.494668:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4600/0xe156d0713be98518 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440c5 expref: 67 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.494691:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390463.494695:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390463.494707:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98588 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390463.495073:0:6493:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788390463.495203:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9858f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.495217:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9858f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.495227:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9858f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.495275:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98588 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440e8 expref: 69 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.495313:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9858f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440e8 expref: 68 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.495376:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984f89fabe00) 00010000:00010000:0.0:1788390463.495380:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390463.495383:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81c00, rc 0) 00000100:00100000:0.0:1788390463.495457:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+68:12489:x1875263088589184:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 847us (2363us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788390463.495465:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 235 00000100:00100000:2.0:1788390463.507890:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390463.508014:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088589440 00000100:00100000:0.0:1788390463.508037:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088589440 00000100:00100000:0.0:1788390463.508137:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 236 00000100:00100000:0.0:1788390463.508150:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+68:12489:x1875263088589440:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788390463.508229:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390463.508257:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be9858f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440e8 expref: 68 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508280:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984f89fabe00) 00010000:00010000:0.0:1788390463.508291:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390463.508380:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508395:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508619:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508656:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508665:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508675:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508725:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508732:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508739:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508745:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390463.508749:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508757:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508765:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390463.508768:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390463.508772:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508778:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be9859d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508795:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508801:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508807:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508812:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390463.508815:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508822:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508829:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4a54db9 (ffff984f89fab100) 00010000:00010000:0.0:1788390463.508831:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390463.508834:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.508839:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985a4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4a54db9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.508947:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:12489:x1875263088589440:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 799us (1074us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390463.508955:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 236 00000100:00100000:2.0:1788390463.513108:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.513977:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088589568 00000100:00100000:3.0:1788390463.513993:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088589568 00000100:00100000:3.0:1788390463.514082:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 237 00000100:00100000:3.0:1788390463.514096:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+67:12489:x1875263088589568:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390463.514125:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390463.514158:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be985ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440ef expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.514202:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.514214:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.514226:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.515088:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be985ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440ef expref: 69 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.515117:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440ef expref: 68 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.515139:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:3.0:1788390463.515142:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788390463.515147:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf000, rc 0) 00000100:00100000:3.0:1788390463.515243:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+68:12489:x1875263088589568:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 1149us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.515253:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 237 00000100:00100000:2.0:1788390463.520139:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390463.520237:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088589824 00000100:00100000:0.0:1788390463.520255:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088589824 00000100:00100000:0.0:1788390463.520375:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 238 00000100:00100000:0.0:1788390463.520685:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+68:12489:x1875263088589824:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788390463.520775:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.520794:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.520807:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390463.520993:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788390463.521005:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 284078682160ns, next at 285078679037ns, rc = 0 00000004:00010000:0.0:1788390463.521057:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2f9f0ce reply state 00000000071df565 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.521070:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.521079:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:0.0:1788390463.521082:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788390463.521086:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390463.521193:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+70:12489:x1875263088589824:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 793us (1071us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788390463.521202:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 238 00000100:00100000:2.0:1788390463.523695:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.523787:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088589952 00000100:00100000:1.0:1788390463.523806:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088589952 00000100:00100000:1.0:1788390463.523921:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 239 00000100:00100000:1.0:1788390463.523936:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+70:12489:x1875263088589952:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390463.523968:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390463.523993:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.524051:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440f6 expref: 71 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.524066:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440f6 expref: 71 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.524086:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:1.0:1788390463.524089:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390463.524094:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5a00, rc 0) 00000100:00100000:1.0:1788390463.524168:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+71:12489:x1875263088589952:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 236us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390463.524176:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 239 00000100:00100000:2.0:1788390463.526558:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.526649:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088590080 00000100:00100000:1.0:1788390463.526661:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088590080 00000100:00100000:1.0:1788390463.526739:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 70 00000100:00100000:1.0:1788390463.526748:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2404:x1875263088590080:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788390463.527038:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2404:x1875263088590080:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 290us (491us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788390463.527045:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 70 00000100:00100000:2.0:1788390463.530933:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.531018:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088590336 00000100:00100000:3.0:1788390463.531032:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088590336 00000100:00100000:3.0:1788390463.531098:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:3.0:1788390463.531108:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+71:12489:x1875263088590336:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788390463.531597:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+72:12489:x1875263088590336:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 489us (682us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788390463.531603:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:2.0:1788390463.534698:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.534805:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088590592 00000100:00100000:3.0:1788390463.534819:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088590592 00000100:00100000:3.0:1788390463.534955:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 240 00000100:00100000:3.0:1788390463.534967:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+72:12489:x1875263088590592:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390463.535136:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+72:12489:x1875263088590592:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 171us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.535144:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 240 00000100:00100000:2.0:1788390463.537681:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.537773:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088590720 00000100:00100000:1.0:1788390463.537805:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088590720 00000100:00100000:1.0:1788390463.537887:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 241 00000100:00100000:1.0:1788390463.537908:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+72:12489:x1875263088590720:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390463.537934:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390463.537963:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be985c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2440fd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.538057:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be985ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.538087:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be985ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.538101:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be985ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390463.538163:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390463.538189:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be985ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.538221:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be985c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440fd expref: 74 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.538246:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be985ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440fd expref: 73 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.538257:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:1.0:1788390463.538260:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788390463.538264:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5e00, rc 0) 00000100:00100000:1.0:1788390463.538395:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+73:12489:x1875263088590720:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 492us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390463.539164:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 241 00000100:00100000:2.0:1788390463.541997:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390463.542187:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088590848 00000100:00100000:0.0:1788390463.542201:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088590848 00000100:00100000:0.0:1788390463.542310:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 71 00000100:00100000:0.0:1788390463.542372:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+10:2405:x1875263088590848:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390463.542412:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390463.542458:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244104 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390463.542494:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ac3f, blocks: 0x0 00010000:00010000:0.0:1788390463.542520:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1788390463.542526:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390463.542538:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244104 expref: 11 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.542560:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244104 expref: 11 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.542578:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80a00, rc 0) 00000100:00100000:0.0:1788390463.542656:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2405:x1875263088590848:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 335us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390463.542663:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 71 00000100:00100000:1.0:1788390463.545829:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.545932:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088591104 00000100:00100000:3.0:1788390463.545946:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088591104 00000100:00100000:3.0:1788390463.546016:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 242 00000100:00100000:3.0:1788390463.546031:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+73:12489:x1875263088591104:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390463.546195:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+73:12489:x1875263088591104:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 169us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.546201:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 242 00000100:00100000:3.0:1788390463.550362:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390463.550552:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088591232 00000100:00100000:0.0:1788390463.550564:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088591232 00000100:00100000:0.0:1788390463.550624:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 72 00000100:00100000:0.0:1788390463.550633:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:12489:x1875263088591232:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390463.550654:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390463.550675:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24410b expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.550708:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244104 expref: 12 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.550736:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390463.550740:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390463.550745:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 12 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.550778:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244104 expref: 12 pid: 8407 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.550790:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244104 expref: 12 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.550803:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1875263098051072:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390463.550997:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390463.555248:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1875263098051072:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390463.555300:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 12 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.555541:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81800, rc 0) 00000100:00100000:3.0:1788390463.555722:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+12:12489:x1875263088591232:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 5087us (5396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.555733:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 72 00000100:00100000:0.0:1788390463.557028:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.558354:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088591360 00000100:00100000:1.0:1788390463.558370:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088591360 00010000:00010000:1.0:1788390463.558440:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244104 expref: 12 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390463.558497:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 102 00000100:00100000:1.0:1788390463.558509:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+12:2404:x1875263088591360:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390463.558526:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390463.558555:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244104 expref: 12 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.558571:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244104 expref: 12 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.558602:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060a148b7/0xe156d0713be985d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244104 expref: 12 pid: 8407 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.558622:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390463.558626:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390463.558636:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 11 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.558648:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 11 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.558719:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 11 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390463.558736:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88821500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6479:1875263098051200:192.168.202.11@tcp:105: 00000100:00100000:1.0:1788390463.558856:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390463.562199:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88821500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6479:1875263098051200:192.168.202.11@tcp:105: 00010000:00010000:1.0:1788390463.562238:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390463.562386:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2404:x1875263088591360:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 3878us (5365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390463.562399:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 102 00000100:00100000:0.0:1788390463.563456:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.563548:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088591488 00000100:00100000:1.0:1788390463.563559:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088591488 00002000:00100000:1.0:1788390463.563623:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff984e88834000 x1875263088591488/t0(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:79/0 lens 504/0 e 0 to 0 dl 1788390474 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390463.563635:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e88834000 with x1875263088591488 ext(0->12) 00002000:00010000:1.0:1788390463.563642:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e88834000 00000100:00100000:1.0:1788390463.563676:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:1.0:1788390463.563687:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+11:2404:x1875263088591488:12345-192.168.202.11@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788390463.564639:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+13:2404:x1875263088591488:12345-192.168.202.11@tcp:4:lhsmtool_posix.0 Request processed in 947us (1185us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788390463.564651:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 6 00002000:00100000:1.0:1788390463.564663:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff984e88834000 x1875263088591488/t4294967321(0) o4->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:79/0 lens 504/448 e 0 to 0 dl 1788390474 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390463.564691:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e88834000 with x1875263088591488 ext(0->12) 00002000:00010000:1.0:1788390463.564696:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e88834000 00000100:00100000:2.0:1788390463.567826:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.567959:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088591616 00000100:00100000:3.0:1788390463.567973:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088591616 00000100:00100000:3.0:1788390463.568092:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 243 00000100:00100000:3.0:1788390463.568105:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+73:12489:x1875263088591616:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788390463.570400:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1788390463.570417:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788390463.570465:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788390463.570483:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984e86833000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788390463.570487:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e87a34600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984e86833240 00000020:00080000:0.0:1788390463.570489:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e87a34e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984e865d8a00 00000004:00080000:0.0:1788390463.570514:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788390463.570540:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984fbb069180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788390463.570542:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984f86188e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984fbb069600 00000020:00080000:0.0:1788390463.570550:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984f86188000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984e879e9000 00000004:00080000:3.0:1788390463.570567:0:10069:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284128243100ns, next at 285128237710ns, rc = 0 00000100:00100000:3.0:1788390463.570631:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098051328:0@lo:13:osp-pre-1-0.0 00000020:00080000:0.0:1788390463.570689:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1788390463.570729:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788390463.570732:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788390463.570749:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098051456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390463.570790:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098051840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788390463.570829:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390463.570836:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390463.570908:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098051328 00000100:00100000:0.0:1788390463.570917:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098051328 00000100:00100000:0.0:1788390463.570978:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098051456 00000100:00100000:0.0:1788390463.570982:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098051456 00000100:00100000:2.0:1788390463.570993:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098051584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788390463.571016:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788390463.571028:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3622:x1875263098051328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390463.571049:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390463.571087:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3622:x1875263098051328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390463.571091:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788390463.571105:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788390463.571109:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098051456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788390463.571115:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788390463.571131:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098051456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 22us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390463.571135:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1788390463.571150:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390463.571159:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098051712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788390463.571197:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098051456:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788390463.574544:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574561:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574569:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574576:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cf600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390463.574581:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574589:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574607:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff984fb7863400) 00010000:00010000:1.0:1788390463.574610:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390463.574614:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574618:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be982e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574643:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574647:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574666:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574669:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cf400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390463.574671:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574674:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574680:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff984f89fab900) 00010000:00010000:1.0:1788390463.574681:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390463.574683:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574687:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cf400/0xe156d0713be98389 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574698:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574701:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574705:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574708:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390463.574709:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574718:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574723:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f89fab600) 00010000:00010000:1.0:1788390463.574725:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390463.574726:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574729:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5400/0xe156d0713be98407 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574738:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574742:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574746:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574748:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390463.574750:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574753:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574756:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f89fab600) 00010000:00010000:1.0:1788390463.574758:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390463.574759:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574765:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be9842a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574774:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574777:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574781:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574784:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390463.574785:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574788:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574795:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390463.574797:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390463.574800:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574804:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be984fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574814:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574820:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574831:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574836:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390463.574839:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574844:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.574852:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:1.0:1788390463.574855:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788390463.574968:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390463.575050:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098051840 00000100:00100000:0.0:1788390463.575058:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098051840 00000100:00100000:0.0:1788390463.575097:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098051712 00000100:00100000:0.0:1788390463.575101:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098051712 00000100:00100000:0.0:1788390463.575129:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788390463.575138:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3622:x1875263098051840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788390463.575170:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00000100:00100000:3.0:1788390463.575194:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098051328:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1788390463.575202:0:8407:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a98ac3e, atime: 0x6a98ac3e, ctime: 0x6a98ac3e, blocks: 0x8 00010000:00010000:0.0:1788390463.575212:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.575227:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=284s v=(0 0) 00000100:00100000:3.0:1788390463.575435:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098052352:0@lo:400:kworker.0 00000100:00100000:3.0:1788390463.575510:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390463.575531:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098052864:0@lo:400:kworker.0 00000100:00100000:3.0:1788390463.575550:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390463.575558:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788390463.575562:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098051968:0@lo:400:kworker.0 00000100:00100000:3.0:1788390463.575579:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390463.575606:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098052480:0@lo:400:kworker.0 00000100:00100000:3.0:1788390463.575622:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390463.575632:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098052992:0@lo:400:kworker.0 00000100:00100000:3.0:1788390463.575644:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390463.575664:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098052352 00000100:00100000:3.0:1788390463.575668:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098052352 00000100:00100000:3.0:1788390463.575698:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098052992 00000100:00100000:3.0:1788390463.575700:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098052992 00000100:00100000:3.0:1788390463.575720:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788390463.575726:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098052352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390463.575764:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098052352:12345-0@lo:400:kworker.0 Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.575771:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788390463.575789:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788390463.575796:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098052992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390463.575822:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098052992:12345-0@lo:400:kworker.0 Request processed in 26us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.575828:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788390463.575855:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098052992:0@lo:400:kworker.0 00000100:00100000:3.0:1788390463.575875:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098052352:0@lo:400:kworker.0 00010000:00010000:1.0:1788390463.575968:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.575979:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be985b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390463.576026:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12489:x1875263088591616:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 Request processed in 7920us (8210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.576035:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 243 00010000:00010000:0.0:1788390463.576064:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390463.576072:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.576089:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.576098:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.576106:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.576131:0:8407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788390463.576971:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390463.576971:0:13156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390463.576979:0:13156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.576991:0:13156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390463.576997:0:13156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.577006:0:13156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.577030:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098051968 00000100:00100000:2.0:1788390463.577039:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098051968 00010000:00010000:1.0:1788390463.577039:0:13156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.577051:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000942793d7/0xe156d0713be985e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.577071:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390463.577073:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390463.577076:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390463.577111:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788390463.577124:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098051968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.577204:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3622:x1875263098051968:12345-0@lo:400:kworker.0 Request processed in 83us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.577213:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788390463.577275:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098052096:0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.577311:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390463.577361:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098052096 00000100:00100000:2.0:1788390463.577366:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098052096 00000100:00100000:2.0:1788390463.577404:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788390463.577411:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098052096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.577447:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098052096:12345-0@lo:400:kworker.0 Request processed in 37us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.577455:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788390463.577455:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3622:x1875263098051840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2249us (6551us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788390463.577484:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788390463.577509:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098052096:0@lo:400:kworker.0 00000100:00100000:0.0:1788390463.577516:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098052864 00000100:00100000:2.0:1788390463.577522:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098052608:0@lo:400:kworker.0 00000100:00100000:0.0:1788390463.577526:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098052864 00000100:00100000:0.0:1788390463.577558:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098051584 00000100:00100000:0.0:1788390463.577561:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098051584 00000100:00100000:2.0:1788390463.577580:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390463.577585:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390463.577600:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098052864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.577613:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098053120:0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.577661:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390463.577669:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098052864:12345-0@lo:400:kworker.0 Request processed in 71us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390463.577676:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390463.577689:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788390463.577695:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3625:x1875263098051712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788390463.577794:0:8407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788390463.577798:0:8407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788390463 00002000:00010000:0.0:1788390463.577800:0:8407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788390463.577803:0:8407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788390463 -> 1788390463 00002000:00010000:0.0:1788390463.577805:0:8407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788390463.577838:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788390463.577848:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3625:x1875263098051712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (2875us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788390463.577859:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbf8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3624:x1875263098051584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788390463.577885:0:8798:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1788390463.577921:0:8798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.577945:0:8798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244063 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.577955:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788390463.577960:0:8798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390463.577965:0:8798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.578002:0:8798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244063 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.578018:0:8798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244063 expref: 12 pid: 8408 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390463.578031:0:8798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8825ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098053248:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390463.578611:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098051968:0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.578631:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788390463.578641:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098052864:0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.578649:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098052224:0@lo:400:kworker.0 00000004:00080000:1.0:1788390463.578663:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e88835500/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788390463.578672:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098051840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788390463.578702:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390463.578724:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098052608 00000100:00100000:1.0:1788390463.578730:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098052608 00000100:00100000:2.0:1788390463.578754:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098052480 00000100:00100000:2.0:1788390463.578762:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098052480 00000100:00100000:1.0:1788390463.578790:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098053120 00000100:00100000:1.0:1788390463.578796:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098053120 00000100:00100000:2.0:1788390463.578812:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098052224 00000100:00100000:2.0:1788390463.578818:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098052224 00000100:00100000:1.0:1788390463.578835:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788390463.578857:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788390463.578870:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098052480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.578938:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098052480:12345-0@lo:400:kworker.0 Request processed in 71us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.578946:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788390463.578963:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788390463.578965:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098052608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.578972:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098052224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390463.579002:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098052480:0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.579027:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098052224:12345-0@lo:400:kworker.0 Request processed in 54us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.579036:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788390463.579090:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788390463.579104:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098053120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390463.579108:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098052608:12345-0@lo:400:kworker.0 Request processed in 256us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390463.579119:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788390463.579145:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875263098053120:12345-0@lo:400:kworker.0 Request processed in 46us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.579151:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788390463.579186:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098052224:0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.579194:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098052736:0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.579214:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390463.579222:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788390463.579252:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098052608:0@lo:400:kworker.0 00010000:00080000:2.0:1788390463.579263:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88374a80 x1875263098053120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390463.579281:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3624:1875263098053120:0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.579306:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098052736 00000100:00100000:2.0:1788390463.579308:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098052736 00000100:00100000:2.0:1788390463.579346:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788390463.579350:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098052736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390463.579373:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098052736:12345-0@lo:400:kworker.0 Request processed in 23us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.579377:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00010000:00080000:2.0:1788390463.579393:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88374000 x1875263098052736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390463.579399:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098052736:0@lo:400:kworker.0 00000100:00080000:0.0:1788390463.579648:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788390463.579653:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788390463.579692:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e88834700/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788390463.579698:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098051712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788390463.586303:0:8798:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb0690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390463.586919:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390463.587056:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088591744 00000100:00100000:2.0:1788390463.587066:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088591744 00000100:00100000:2.0:1788390463.587154:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 76 00000100:00100000:2.0:1788390463.587165:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+13:2405:x1875263088591744:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788390463.588469:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1788390463.588487:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788390463.588767:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088591744:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 Request processed in 1599us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.588777:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 76 00000100:00100000:0.0:1788390463.589228:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.589390:0:8798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8825ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8798:1875263098053248:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390463.589417:0:8798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390463.590051:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088591872 00000100:00100000:3.0:1788390463.590102:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088591872 00010000:00010000:3.0:1788390463.590131:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244063 expref: 8 pid: 8408 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390463.590161:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 103 00000100:00100000:3.0:1788390463.590167:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088591872:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390463.590178:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390463.590182:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244063 expref: 8 pid: 8408 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.590191:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244063 expref: 8 pid: 8408 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.590209:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007509341f/0xe156d0713be98397 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244063 expref: 8 pid: 8408 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.590307:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390463.590311:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788390463.590315:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.590358:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.590390:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390463.590428:0:8798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.590440:0:8798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.590455:0:8798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.590464:0:8798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390463.590498:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088591872:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 328us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.590505:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 103 00010000:00010000:1.0:1788390463.590538:0:8798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788390463.590715:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbf8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098051584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12862us (13748us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788390463.590723:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788390463.590937:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788390463.590942:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1788390463.590957:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984e88834700, transno 4294967322 00000100:00100000:3.0:1788390463.591000:0:3624:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff984e88835180 x1875263098051584/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788390479 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788390463.591010:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e88835180/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788390463.591041:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.591125:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098051584:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788390463.591965:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390463.591974:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.591986:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfe00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390463.591992:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.592005:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088592128 00000100:00100000:0.0:1788390463.592014:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088592128 00010000:00010000:2.0:1788390463.592017:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.592037:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.592045:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a92d958/0xe156d0713be985ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.592065:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 244 00010000:00010000:2.0:1788390463.592071:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390463.592075:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12489:x1875263088592128:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788390463.592076:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390463.592079:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390463.592121:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390463.592135:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be985ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440fd expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.592147:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:0.0:1788390463.592149:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390463.592172:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.592182:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.592187:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390463.592492:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000965baa13 reply state 00000000781a3d84 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.592501:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.592505:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:0.0:1788390463.592507:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788390463.592509:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390463.592599:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:12489:x1875263088592128:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 527us (1560us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1788390463.592613:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 244 00000100:00100000:0.0:1788390463.598713:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.598864:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088592256 00000100:00100000:3.0:1788390463.598881:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088592256 00000100:00100000:3.0:1788390463.598972:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 77 00000100:00100000:3.0:1788390463.598986:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088592256:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788390463.599451:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788390463.599457:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788390463 -> 1788390462 00002000:00010000:2.0:1788390463.599460:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788390462 00002000:00010000:2.0:1788390463.599462:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788390463 -> 1788390462 00002000:00010000:2.0:1788390463.599464:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788390463.599526:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2404:x1875263088592256:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 540us (820us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788390463.599536:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 77 00000100:00100000:2.0:1788390463.604198:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.604494:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088592512 00000100:00100000:3.0:1788390463.604513:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088592512 00000100:00100000:2.0:1788390463.604705:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 245 00000100:00100000:2.0:1788390463.604719:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:12489:x1875263088592512:12345-192.168.202.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788390463.604803:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.604833:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440ef expref: 22 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.604843:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.604879:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440ef expref: 22 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.604906:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440ef expref: 22 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.604923:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098053376:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390463.605009:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86833480 going to sleep for 11 seconds 00000100:00100000:1.0:1788390463.613947:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390463.614026:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098053376:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390463.614062:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390463.615137:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088592640 00000100:00100000:3.0:1788390463.615154:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088592640 00010000:00010000:3.0:1788390463.615212:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440ef expref: 23 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390463.615269:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 104 00000100:00100000:3.0:1788390463.615301:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+23:2404:x1875263088592640:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390463.615333:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390463.615341:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440ef expref: 23 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.615357:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440ef expref: 23 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.615386:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf000/0xe156d0713be985b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440ef expref: 23 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.615413:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:3.0:1788390463.615420:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.615433:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.615442:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.615562:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390463.615646:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:2404:x1875263088592640:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 343us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.615658:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 104 00010000:00010000:0.0:1788390463.615763:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.615772:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.615824:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.615832:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.615840:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.615846:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390463.615851:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.615859:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.615874:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:0.0:1788390463.615879:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788390463.615883:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.615890:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0c00/0xe156d0713be985f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.615979:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12489:x1875263088592512:12345-192.168.202.11@tcp:55:lhsmtool_posix.0 Request processed in 11264us (11790us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788390463.615988:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 245 00000100:00100000:1.0:1788390463.618943:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390463.619133:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088592768 00000100:00100000:2.0:1788390463.619145:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088592768 00000100:00100000:2.0:1788390463.619236:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 78 00000100:00100000:2.0:1788390463.619248:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088592768:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788390463.619409:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.619432:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.619439:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390463.619443:0:8407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788390463.619447:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.619483:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.619497:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 8 pid: 8409 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.619510:0:8407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1875263098053504:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390463.619599:0:8407:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86833480 going to sleep for 11 seconds 00000100:00100000:2.0:1788390463.624259:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.624372:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088592896 00000100:00100000:1.0:1788390463.624386:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088592896 00010000:00010000:1.0:1788390463.624448:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 9 pid: 8409 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390463.624494:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 105 00000100:00100000:1.0:1788390463.624505:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088592896:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390463.624543:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390463.624571:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 9 pid: 8409 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.624587:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 9 pid: 8409 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.624618:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390463.624623:0:10369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390463.624630:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.624644:0:10369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.624668:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390463.624758:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+9:2405:x1875263088592896:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 254us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390463.624766:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 105 00010000:00010000:0.0:1788390463.625032:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adef41bb/0xe156d0713be985dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24410b expref: 8 pid: 8409 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.625063:0:8407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1875263098053504:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390463.625092:0:8407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.625105:0:8407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.625114:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.625139:0:8407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.625148:0:8407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.625158:0:8407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.625181:0:8407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390463.625186:0:8407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.625195:0:8407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.625208:0:8407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.625216:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be985ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.625271:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088592768:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 Request processed in 6025us (6342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390463.625280:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 78 00000100:00100000:3.0:1788390463.627773:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.627886:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088593152 00000100:00100000:1.0:1788390463.627911:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088593152 00000100:00100000:1.0:1788390463.628015:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 246 00000100:00100000:1.0:1788390463.628026:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:12489:x1875263088593152:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788390463.628126:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.628146:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b7 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.628186:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.628230:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b7 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.628247:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b7 expref: 21 pid: 6493 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390463.628265:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88823100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098053632:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390463.628508:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86be2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390463.630970:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88823100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098053632:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390463.631203:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.631227:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.631258:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088593280 00000100:00100000:1.0:1788390463.631266:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088593280 00010000:00010000:1.0:1788390463.631313:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b7 expref: 22 pid: 6493 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390463.631422:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 106 00000100:00100000:1.0:1788390463.631434:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:2405:x1875263088593280:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390463.631454:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390463.631462:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b7 expref: 22 pid: 6493 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.631501:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b7 expref: 22 pid: 6493 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.631527:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be984f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440b7 expref: 22 pid: 6493 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.631548:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390463.631554:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440da expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.631565:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.631573:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.631582:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.631612:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390463.631639:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.631647:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390463.631689:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:2405:x1875263088593280:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 257us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390463.631697:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 106 00010000:00010000:2.0:1788390463.632913:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.632936:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440f6 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.632963:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.633011:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440f6 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.633023:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440f6 expref: 21 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.633037:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098053760:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390463.633128:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86833780 going to sleep for 11 seconds 00010000:00010000:2.0:1788390463.633419:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390463.635565:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.635726:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088593408 00000100:00100000:3.0:1788390463.635740:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088593408 00010000:00010000:3.0:1788390463.635812:0:10369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440f6 expref: 22 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390463.635909:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098053760:192.168.202.11@tcp:104: 00010000:00010000:1.0:1788390463.635940:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.636527:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 107 00000100:00100000:2.0:1788390463.636543:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+22:2404:x1875263088593408:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390463.636565:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390463.636575:0:10369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440f6 expref: 22 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.636590:0:10369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440f6 expref: 22 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.636619:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be985c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440f6 expref: 22 pid: 6492 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.636645:0:10369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:2.0:1788390463.636657:0:10369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.636666:0:10369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.636672:0:10369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.636696:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390463.636753:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:2404:x1875263088593408:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 216us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.636761:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 107 00010000:00010000:1.0:1788390463.636813:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.636829:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390463.637004:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1788390463.637177:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1788390463.637223:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788390463.637397:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88821500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6494:1875263098053888:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788390463.637465:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390463.637499:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f8caf9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390463.637570:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098053888 00000100:00100000:3.0:1788390463.637580:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098053888 00000100:00100000:3.0:1788390463.637666:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788390463.637677:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6494:x1875263098053888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788390463.637786:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6494:x1875263098053888:12345-0@lo:1000:mdt00_002.0 Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390463.637794:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788390463.637862:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88821500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6494:1875263098053888:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788390463.638289:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788390463.638377:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6494:1875263098054016:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788390463.638417:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390463.638504:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f99f8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390463.638943:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098054016 00000100:00100000:0.0:1788390463.638950:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098054016 00000100:00100000:0.0:1788390463.639005:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788390463.639016:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6494:x1875263098054016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788390463.639276:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6494:x1875263098054016:12345-0@lo:1000:mdt00_002.0 Request processed in 260us (857us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788390463.639284:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788390463.639341:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6494:1875263098054016:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788390463.639386:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639396:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639405:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639411:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390463.639416:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639442:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639464:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:2.0:1788390463.639468:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390463.639473:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639480:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be9860d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639516:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639523:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639528:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639534:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390463.639537:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639543:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639552:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:2.0:1788390463.639554:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390463.639560:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440da expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639578:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440da expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639585:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440da expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.639609:0:6494:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440da expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.639618:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098054144:192.168.202.11@tcp:105: 00000100:00100000:2.0:1788390463.639699:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f8caf9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390463.642544:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.642559:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875263098054144:192.168.202.11@tcp:105: 00010000:00010000:1.0:1788390463.642597:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642609:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4400/0xe156d0713be98550 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.642635:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088593536 00000100:00100000:0.0:1788390463.642643:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088593536 00010000:00010000:1.0:1788390463.642653:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642668:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642681:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642691:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642697:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642714:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642720:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390463.642724:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.642725:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 61 00010000:00010000:1.0:1788390463.642732:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.642735:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:12488:x1875263088593536:12345-192.168.202.11@tcp:49:lfs.0 00010000:00010000:1.0:1788390463.642744:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390463.642748:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390463.642751:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642756:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98614 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642766:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642771:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642776:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642781:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390463.642783:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642797:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642804:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390463.642806:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788390463.642809:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.642814:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98606 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390463.642909:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:12488:x1875263088593536:12345-192.168.202.11@tcp:49:lfs.0 Request processed in 174us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390463.642916:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 61 00000100:00100000:1.0:1788390463.642981:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:12489:x1875263088593152:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 14956us (15219us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788390463.642990:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 246 00000020:00080000:1.0:1788390463.642993:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788390463.643059:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390463.643065:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390463.643579:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788390463.643589:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390463.645997:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390463.646048:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390463.646149:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088593792 00000100:00100000:3.0:1788390463.646162:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088593792 00000100:00100000:3.0:1788390463.646231:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 62 00000100:00100000:3.0:1788390463.646243:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb604dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+24:12489:x1875263088593792:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788390463.646453:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088594048 00000100:00100000:2.0:1788390463.646459:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088594048 00000100:00100000:2.0:1788390463.646504:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 247 00000100:00100000:2.0:1788390463.646512:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+25:12488:x1875263088594048:12345-192.168.202.11@tcp:58:lfs.0 00000004:00080000:3.0:1788390463.646823:0:14240:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788390463.646823:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000001:00080000:3.0:1788390463.646864:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788390463.646913:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.646935:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.646948:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.646959:0:14240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.646966:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390463.646993:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.647036:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12488:x1875263088594048:12345-192.168.202.11@tcp:58:lfs.0 Request processed in 523us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.647044:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 247 00010000:00010000:3.0:1788390463.647201:0:14240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788390463.647347:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb604dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+26:12489:x1875263088593792:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 1082us (1339us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788390463.647355:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 62 00000020:00080000:3.0:1788390463.647359:0:14240:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390463.651195:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390463.651217:0:13157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.651231:0:13157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390463.651236:0:13157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.651246:0:13157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.651269:0:13157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:1.0:1788390463.651284:0:13157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788390463.651289:0:13157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.651436:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be9861b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390463.651453:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390463.651455:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390463.651457:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390463.682142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390463.683916:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088594176 00000100:00100000:2.0:1788390463.683936:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088594176 00000100:00100000:2.0:1788390463.684034:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 248 00000100:00100000:2.0:1788390463.684048:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+26:12491:x1875263088594176:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390463.684085:0:12122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390463.684134:0:12122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be98622 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244112 expref: -99 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684242:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684260:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684274:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684292:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684299:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684305:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684456:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684468:0:12122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440d3 expref: 27 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684478:0:12122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684522:0:12122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440d3 expref: 27 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.684549:0:12122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440d3 expref: 27 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.684566:0:12122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098054272:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390463.684657:0:12122:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f99f8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390463.690523:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390463.690646:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088594432 00000100:00100000:1.0:1788390463.690655:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088594432 00000100:00100000:2.0:1788390463.690668:0:12122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12122:1875263098054272:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390463.690703:0:12122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390463.690760:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 63 00000100:00100000:1.0:1788390463.690772:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+28:6166:x1875263088594432:12345-192.168.202.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788390463.691206:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:6166:x1875263088594432:12345-192.168.202.11@tcp:35:ldlm_bl.0 Request processed in 435us (884us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788390463.691215:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 63 00000100:00100000:0.0:1788390463.694007:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390463.694681:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088594560 00000100:00100000:2.0:1788390463.694692:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088594560 00010000:00010000:2.0:1788390463.694738:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440d3 expref: 29 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.694779:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 108 00000100:00100000:2.0:1788390463.694790:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:2405:x1875263088594560:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390463.694809:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390463.694817:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440d3 expref: 29 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.694833:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440d3 expref: 29 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.694856:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cee00/0xe156d0713be98542 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440d3 expref: 29 pid: 12122 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.694912:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:2.0:1788390463.694919:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.694931:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.694938:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390463.694968:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390463.695001:0:12122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695009:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390463.695091:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+28:2405:x1875263088594560:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 302us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390463.695100:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 108 00000004:00200000:0.0:1788390463.695199:0:12122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788390463.695204:0:12122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390463.695229:0:12122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695244:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695255:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695273:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695281:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695288:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390463.695293:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695301:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695311:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:0.0:1788390463.695314:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390463.695358:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695365:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0600/0xe156d0713be98629 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695378:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695384:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695390:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695394:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390463.695403:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695410:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695419:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff984f8379b600) 00010000:00010000:0.0:1788390463.695422:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390463.695425:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695430:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0e00/0xe156d0713be98630 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695473:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1e00/0xe156d0713be98622 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244112 expref: 28 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695489:0:12122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244112 expref: 27 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390463.695496:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390463.695498:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390463.695501:0:12122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1800, rc 0) 00000100:00100000:0.0:1788390463.695531:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12491:x1875263088594176:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 11488us (13407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390463.695539:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 248 00000001:00080000:0.0:1788390464.086721:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788390464.086740:0:9485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:1.0:1788390464.262215:0:14775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788390464.262224:0:14775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390464.262256:0:14775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:1.0:1788390464.262262:0:14775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788390464.657645:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390464.657654:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390464.657712:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:0.0:1788390464.657723:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390464.657863:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098054400:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390464.657998:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982de840 going to sleep for 11 seconds 00010000:00010000:1.0:1788390464.658216:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390464.665127:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13765:1875263098054400:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390464.665724:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390464.665792:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088594688 00000100:00100000:1.0:1788390464.665801:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088594688 00000100:00100000:1.0:1788390464.665866:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 249 00000100:00100000:1.0:1788390464.665875:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12504:x1875263088594688:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788390464.665924:0:6494:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788390464.666061:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12504:x1875263088594688:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 185us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390464.666070:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 249 00000100:00100000:0.0:1788390464.674498:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390464.674582:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088594944 00000100:00100000:2.0:1788390464.674592:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088594944 00000100:00100000:2.0:1788390464.674656:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 250 00000100:00100000:2.0:1788390464.674669:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+27:12504:x1875263088594944:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390464.674687:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390464.674707:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0200/0xe156d0713be9863e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244119 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390464.674816:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be98645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390464.674848:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be98645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390464.674868:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be98645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390464.674880:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788390464.674994:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba0200/0xe156d0713be9863e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244119 expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390464.675014:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be98645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244119 expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390464.675024:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:2.0:1788390464.675026:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390464.675030:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1a00, rc 0) 00000100:00100000:2.0:1788390464.675102:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:12504:x1875263088594944:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 436us (612us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788390464.675109:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 250 00000100:00100000:2.0:1788390464.678739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390464.680627:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088595200 00000100:00100000:0.0:1788390464.680639:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088595200 00000100:00100000:0.0:1788390464.680694:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 251 00000100:00100000:0.0:1788390464.680704:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+29:12504:x1875263088595200:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788390464.680774:0:12122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390464.680787:0:12122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390464.680795:0:12122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390464.680935:0:12122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390464.680941:0:12122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390464.680946:0:12122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390464.680950:0:12122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390464.680953:0:12122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390464.680972:0:12122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390464.680983:0:12122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:0.0:1788390464.680985:0:12122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390464.680988:0:12122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390464.680992:0:12122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80a00/0xe156d0713be98653 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390464.681137:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390464.681143:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788390464.681588:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:12504:x1875263088595200:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 883us (2855us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788390464.681597:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 251 00000040:00080000:2.0:1788390464.681672:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1788390464.681680:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390464.684603:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390464.684662:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088595328 00000100:00100000:3.0:1788390464.684673:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088595328 00000100:00100000:0.0:1788390464.684691:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390464.684810:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088595584 00000100:00100000:2.0:1788390464.684815:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088595584 00000100:00100000:2.0:1788390464.684858:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 64 00000100:00100000:2.0:1788390464.684879:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+31:12504:x1875263088595584:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788390464.685112:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:12504:x1875263088595584:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 236us (419us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788390464.685119:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 64 00000100:00100000:3.0:1788390464.685305:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:3.0:1788390464.685315:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+31:2404:x1875263088595328:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390464.685360:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390464.685385:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1a00/0xe156d0713be98645 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244119 expref: 31 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390464.685487:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:3.0:1788390464.685494:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390464.685535:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:2404:x1875263088595328:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 222us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390464.685543:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 19 00010000:00010000:2.0:1788390465.681505:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390465.814808:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390465.814863:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390465.814913:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390465.814931:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088595712 00000100:00100000:3.0:1788390465.814943:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390465.814946:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088595712 00000100:00100000:3.0:1788390465.814985:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390465.815021:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 369 00000100:00100000:3.0:1788390465.815028:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390465.815038:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2405:x1875263088595712:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390465.815060:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390465.815088:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088595840 00000100:00100000:3.0:1788390465.815093:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088595840 00000100:00100000:1.0:1788390465.815123:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2405:x1875263088595712:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 91us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390465.815130:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 369 00000100:00100000:3.0:1788390465.815146:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088595968 00000100:00100000:3.0:1788390465.815151:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088595968 00000100:00100000:1.0:1788390465.815172:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088596480 00000100:00100000:3.0:1788390465.815175:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088596352 00000100:00100000:1.0:1788390465.815178:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088596480 00000100:00100000:3.0:1788390465.815181:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088596352 00000100:00100000:1.0:1788390465.815203:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 235 00000100:00100000:1.0:1788390465.815210:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:2404:x1875263088595840:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390465.815253:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:2404:x1875263088595840:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 44us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390465.815934:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 236 00000100:00100000:3.0:1788390465.816003:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088595968:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390465.816055:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088595968:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 111us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390465.816063:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 236 00000100:00100000:3.0:1788390465.816086:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 237 00000100:00100000:3.0:1788390465.816094:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2405:x1875263088596480:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390465.816122:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2405:x1875263088596480:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 29us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390465.816129:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 237 00000100:00100000:3.0:1788390465.816143:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 238 00000100:00100000:3.0:1788390465.816150:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088596352:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390465.816176:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2404:x1875263088596352:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 27us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390465.816183:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 238 00000100:00100000:3.0:1788390465.818047:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088596096 00000100:00100000:3.0:1788390465.818064:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088596096 00000100:00100000:3.0:1788390465.818148:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088596224 00000100:00100000:3.0:1788390465.818161:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088596224 00000100:00100000:3.0:1788390465.818205:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 70 00000100:00100000:3.0:1788390465.818486:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088596096:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390465.818588:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2404:x1875263088596096:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 372us (3643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390465.818598:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 70 00000100:00100000:3.0:1788390465.818947:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 71 00000100:00100000:3.0:1788390465.818959:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8825e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088596224:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390465.818995:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8825e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2405:x1875263088596224:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 40us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390465.819003:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 71 00000100:00080000:3.0:1788390465.819042:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390465.819048:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390465.819052:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788390465.819055:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390465.820445:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 235 00000040:00080000:0.0:1788390465.950610:0:14826:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788390465.950620:0:14826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390465.950648:0:14826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:0.0:1788390465.950657:0:14826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788390466.057022:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390466.057113:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088596736 00000100:00100000:1.0:1788390466.057128:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088596736 00000100:00100000:1.0:1788390466.057205:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 252 00000100:00100000:1.0:1788390466.057227:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+30:12524:x1875263088596736:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:1.0:1788390466.057255:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390466.057281:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9865a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244120 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.057451:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98661 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.057468:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.057496:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390466.057511:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788390466.057677:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be9865a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244120 expref: 33 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.057698:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98661 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244120 expref: 32 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.057709:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390466.057713:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788390466.057717:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5000, rc 0) 00000100:00100000:1.0:1788390466.057800:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:12524:x1875263088596736:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 585us (790us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788390466.057808:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 252 00000100:00100000:3.0:1788390466.061034:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390466.061127:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088596864 00000100:00100000:1.0:1788390466.061142:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088596864 00000100:00100000:1.0:1788390466.061225:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 253 00000100:00100000:1.0:1788390466.061239:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:12524:x1875263088596864:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:1.0:1788390466.061373:0:8996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.061393:0:8996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.061408:0:8996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.061464:0:8996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.061473:0:8996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.061480:0:8996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.061487:0:8996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390466.061492:0:8996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.061502:0:8996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.061517:0:8996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390466.061520:0:8996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390466.061526:0:8996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390466.061533:0:8996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be9866f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390466.061625:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+32:12524:x1875263088596864:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 390us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390466.061634:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 253 00000100:00100000:2.0:1788390466.130076:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390466.130107:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098054528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390466.130211:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390466.130518:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098054528 00000100:00100000:3.0:1788390466.130529:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098054528 00000100:00100000:3.0:1788390466.130594:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788390466.130607:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098054528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788390466.130657:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788390466.130727:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098054528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390466.130735:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788390466.130959:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098054528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390466.140156:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390466.140222:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088596992 00000100:00100000:3.0:1788390466.140234:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088596992 00000100:00100000:3.0:1788390466.140367:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 79 00000100:00100000:3.0:1788390466.140389:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2405:x1875263088596992:12345-192.168.202.11@tcp:101:cat.0 00010000:00010000:3.0:1788390466.140418:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390466.140444:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b5a2d6/0xe156d0713be98676 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244127 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390466.140473:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a98ac3e, atime: 0x6a98ac3e, ctime: 0x6a98ac3e, blocks: 0x8 00010000:00010000:3.0:1788390466.140493:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1788390466.140497:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390466.140506:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b5a2d6/0xe156d0713be98676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244127 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390466.140522:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069b5a2d6/0xe156d0713be98676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244127 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390466.140535:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf000, rc 0) 00000100:00100000:3.0:1788390466.140596:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2405:x1875263088596992:12345-192.168.202.11@tcp:101:cat.0 Request processed in 219us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390466.140604:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 79 00000100:00100000:2.0:1788390466.147235:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390466.147347:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088597120 00000100:00100000:0.0:1788390466.147364:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088597120 00002000:00100000:0.0:1788390466.147442:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff984e883ac380 x1875263088597120/t0(0) o3->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:82/0 lens 488/0 e 0 to 0 dl 1788390477 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390466.147456:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e883ac380 with x1875263088597120 ext(0->4095) 00002000:00010000:0.0:1788390466.147464:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e883ac380 00000100:00100000:0.0:1788390466.147535:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:0.0:1788390466.147547:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2406:x1875263088597120:12345-192.168.202.11@tcp:3:cat.0 00000100:00100000:0.0:1788390466.147760:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+8:2406:x1875263088597120:12345-192.168.202.11@tcp:3:cat.0 Request processed in 215us (534us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788390466.147779:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 7 00002000:00100000:0.0:1788390466.147786:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff984e883ac380 x1875263088597120/t0(0) o3->5f86efe9-6df9-4a09-8c7c-860d5e3f89aa@192.168.202.11@tcp:82/0 lens 488/4536 e 0 to 0 dl 1788390477 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788390466.147795:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984e883ac380 with x1875263088597120 ext(0->4095) 00002000:00010000:0.0:1788390466.147798:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff984e883ac380 00010000:00010000:2.0:1788390466.706901:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390467.729650:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390468.178002:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098054656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788390468.178124:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390468.178257:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098054656 00000100:00100000:2.0:1788390468.178265:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098054656 00000100:00100000:2.0:1788390468.178350:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788390468.178360:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098054656:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390468.178391:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098054784:0@lo:13:osp-pre-0-1.0 00000004:00000024:2.0:1788390468.178393:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788390468.178424:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390468.178447:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098054656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390468.178454:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788390468.178482:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098054784 00000100:00100000:3.0:1788390468.178487:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098054784 00000100:00100000:2.0:1788390468.178528:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098054656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390468.178531:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788390468.178540:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098054784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390468.178558:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:2.0:1788390468.178563:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390468.178603:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098054784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390468.178609:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788390468.178621:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098054784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390468.181585:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098054912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390468.181654:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390468.182101:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098054912 00000100:00100000:0.0:1788390468.182109:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098054912 00000100:00100000:0.0:1788390468.182213:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788390468.182224:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875263098054912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390468.182246:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788390468.182293:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875263098054912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390468.182300:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788390468.182375:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098054912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788390468.185756:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390468.689710:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390468.689972:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098055168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390468.690043:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098055296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390468.690114:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390468.690180:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098055296 00000100:00100000:3.0:1788390468.690187:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098055296 00000100:00100000:3.0:1788390468.690236:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788390468.690244:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098055296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390468.690269:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390468.690307:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098055296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390468.690314:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788390468.690362:0:3623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788390468.690373:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1788390468.690390:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984e87ac2a00, transno 4294967308 00000004:00080000:3.0:1788390468.690399:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788390468.690408:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984e88835500, transno 4294967311 00000100:00100000:3.0:1788390468.690418:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098055296:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788390468.690437:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390468.690964:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390468.692662:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098055424:0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.692678:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098055168 00000100:00100000:3.0:1788390468.692687:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098055168 00000100:00100000:1.0:1788390468.692726:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390468.692762:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788390468.692766:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984f85ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098055040:0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.692774:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098055168:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390468.692795:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788390468.692799:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788390468.692832:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098055424 00000100:00100000:1.0:1788390468.692837:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098055424 00000100:00100000:3.0:1788390468.692873:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098055168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390468.692897:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788390468.692919:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390468.693141:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788390468.693150:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098055424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390468.693188:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098055424:12345-0@lo:400:kworker.0 Request processed in 40us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390468.693247:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098055040 00000100:00100000:2.0:1788390468.693251:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098055040 00000100:00100000:2.0:1788390468.693279:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788390468.693285:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263098055040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390468.693313:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263098055040:12345-0@lo:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390468.693333:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788390468.693564:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098055168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390468.693598:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098055424:0@lo:400:kworker.0 00000100:00100000:2.0:1788390468.693606:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984f85ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098055040:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696107:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098055808:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696174:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390468.696205:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098056320:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696227:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390468.696265:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788390468.696271:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263098055680:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696293:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390468.696308:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098056192:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696345:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390468.696380:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098055808 00000100:00100000:0.0:1788390468.696386:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098055808 00000100:00100000:0.0:1788390468.696430:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788390468.696439:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098055808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696492:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098055808:12345-0@lo:400:kworker.0 Request processed in 54us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390468.696499:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788390468.696538:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098056320 00000100:00100000:0.0:1788390468.696541:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098056320 00000100:00100000:0.0:1788390468.696559:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098056192 00000100:00100000:0.0:1788390468.696562:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098056192 00000100:00100000:0.0:1788390468.696578:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788390468.696583:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3623:x1875263098056320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696610:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3623:x1875263098056320:12345-0@lo:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390468.696615:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788390468.696626:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788390468.696630:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098056192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696648:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098056192:12345-0@lo:400:kworker.0 Request processed in 18us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390468.696653:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788390468.696667:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098055680 00000100:00100000:0.0:1788390468.696675:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098055680 00000100:00100000:0.0:1788390468.696696:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788390468.696701:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263098055680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696725:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263098055680:12345-0@lo:400:kworker.0 Request processed in 23us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390468.696730:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788390468.696780:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263098055680:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696789:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098056192:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696796:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098055808:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.696803:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098056320:0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697004:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098055552:0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697038:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390468.697067:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098056064:0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697102:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390468.697120:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098056576:0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697140:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390468.697156:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788390468.697162:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098055936:0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697180:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390468.697195:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e878bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263098056448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697214:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390468.697242:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098056064 00000100:00100000:3.0:1788390468.697246:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098056064 00000100:00100000:3.0:1788390468.697271:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098056576 00000100:00100000:3.0:1788390468.697274:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098056576 00000100:00100000:3.0:1788390468.697286:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098055936 00000100:00100000:3.0:1788390468.697288:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098055936 00000100:00100000:3.0:1788390468.697297:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098056448 00000100:00100000:3.0:1788390468.697300:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098056448 00000100:00100000:3.0:1788390468.697314:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788390468.697345:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098056064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697382:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098056064:12345-0@lo:400:kworker.0 Request processed in 61us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390468.697389:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788390468.697411:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788390468.697417:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098056576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697448:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098056576:12345-0@lo:400:kworker.0 Request processed in 31us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390468.697454:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788390468.697465:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788390468.697470:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098055936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697495:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875263098055936:12345-0@lo:400:kworker.0 Request processed in 24us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390468.697501:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788390468.697511:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788390468.697518:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263098056448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697543:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263098056448:12345-0@lo:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390468.697548:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788390468.697566:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390468.697569:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390468.697596:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3625:1875263098055936:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.697604:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098055552 00000100:00100000:3.0:1788390468.697610:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263098056448:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.697610:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098055552 00010000:00080000:3.0:1788390468.697626:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e868c5c00 x1875263098056064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390468.697638:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098056064:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.697644:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00010000:00080000:3.0:1788390468.697650:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88241180 x1875263098056576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390468.697656:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098055552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390468.697679:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098056576:0@lo:400:kworker.0 00000100:00100000:0.0:1788390468.697700:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098055552:12345-0@lo:400:kworker.0 Request processed in 47us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390468.697706:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788390468.697711:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e878b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098055552:0@lo:400:kworker.0 00000001:00080000:2.0:1788390468.699071:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1788390468.699100:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984e86833cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788390468.699105:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e87a34c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984e86833780 00000020:00080000:2.0:1788390468.699108:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984e87a34b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984e88109a00 00000020:00080000:2.0:1788390468.699131:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:2.0:1788390468.699136:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00010000:00010000:0.0:1788390468.699241:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390468.699253:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390468.699261:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390468.699269:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390468.699283:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390468.699292:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390468.699309:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff984fb7863e00) 00010000:00010000:0.0:1788390468.699313:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390468.699317:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390468.699360:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be985f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788390468.699387:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788390468.699458:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788390468.699600:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00010000:1.0:1788390468.753923:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788390469.205553:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788390469.205572:0:8402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:0.0:1788390469.586647:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390469.586905:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088597248 00000100:00100000:3.0:1788390469.586917:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088597248 00000100:00100000:3.0:1788390469.586997:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 254 00000100:00100000:3.0:1788390469.587008:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:12168:x1875263088597248:12345-192.168.202.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788390469.587133:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:12168:x1875263088597248:12345-192.168.202.11@tcp:60:lhsmtool_posix.0 Request processed in 126us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390469.587141:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 254 00000100:00080000:0.0:1788390469.587247:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390469.595396:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390469.595460:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088597376 00000100:00100000:3.0:1788390469.595471:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088597376 00000100:00100000:3.0:1788390469.595539:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 255 00000100:00100000:3.0:1788390469.595550:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:12168:x1875263088597376:12345-192.168.202.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788390469.595660:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:12168:x1875263088597376:12345-192.168.202.11@tcp:60:lhsmtool_posix.0 Request processed in 112us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390469.595668:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 255 00000100:00080000:0.0:1788390469.596595:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788390469.600732:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390469.600920:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088597632 00000100:00100000:1.0:1788390469.600930:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088597632 00000100:00100000:1.0:1788390469.601024:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 65 00000100:00100000:1.0:1788390469.601035:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:12168:x1875263088597632:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788390469.601297:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:12168:x1875263088597632:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 264us (575us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788390469.601305:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 65 00000100:00100000:2.0:1788390469.721071:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390469.721186:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088597760 00000100:00100000:1.0:1788390469.721196:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088597760 00000100:00100000:1.0:1788390469.721277:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 256 00000100:00100000:1.0:1788390469.721290:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:12981:x1875263088597760:12345-192.168.202.11@tcp:101:lsof.0 00010000:00010000:1.0:1788390469.721311:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390469.721425:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be9867d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24412e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390469.721516:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98684 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390469.721531:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390469.721544:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390469.721592:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788390469.721596:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390469.721617:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98684 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390469.721642:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5a00/0xe156d0713be9867d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24412e expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390469.721660:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98684 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24412e expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390469.721670:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863800) 00010000:00010000:1.0:1788390469.721672:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390469.721676:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4400, rc 0) 00000100:00100000:1.0:1788390469.721740:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:12981:x1875263088597760:12345-192.168.202.11@tcp:101:lsof.0 Request processed in 452us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390469.721748:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 256 00000100:00080000:0.0:1788390469.721985:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390469.779011:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390470.801503:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390470.865542:0:13765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390470.865550:0:13765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390470.865614:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788390470.865619:0:13765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788390470.936383:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390470.936431:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390470.936457:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088597888 00000100:00100000:0.0:1788390470.936464:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390470.936470:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088597888 00000100:00100000:0.0:1788390470.936489:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390470.936510:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390470.936530:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390470.936544:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 371 00000100:00100000:2.0:1788390470.936556:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088597888:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390470.936561:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390470.936586:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088598400 00000100:00100000:0.0:1788390470.936590:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088598400 00000100:00100000:0.0:1788390470.936629:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088598272 00000100:00100000:0.0:1788390470.936632:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088598272 00000100:00100000:2.0:1788390470.936635:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2407:x1875263088597888:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390470.936646:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 371 00000100:00100000:0.0:1788390470.936666:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 74 00000100:00100000:0.0:1788390470.936676:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088598400:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390470.936708:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088598400:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 35us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390470.936715:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 74 00000100:00100000:0.0:1788390470.936732:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 75 00000100:00100000:0.0:1788390470.936738:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2407:x1875263088598272:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390470.936763:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2407:x1875263088598272:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 26us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390470.936769:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 75 00000100:00080000:0.0:1788390470.936796:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390470.936801:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390470.937400:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088598144 00000100:00100000:1.0:1788390470.937407:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088598144 00000100:00100000:1.0:1788390470.937494:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088598656 00000100:00100000:1.0:1788390470.937498:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088598656 00000100:00100000:1.0:1788390470.937545:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088598016 00000100:00100000:1.0:1788390470.937549:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088598016 00000100:00100000:3.0:1788390470.937571:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088598528 00000100:00100000:3.0:1788390470.937577:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088598528 00000100:00100000:1.0:1788390470.937586:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 245 00000100:00100000:1.0:1788390470.937597:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088598144:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390470.937632:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 246 00000100:00100000:3.0:1788390470.937641:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088598656:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390470.937660:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2407:x1875263088598144:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 64us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390470.937668:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 245 00000100:00100000:3.0:1788390470.937673:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2407:x1875263088598656:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 33us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390470.937690:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 246 00000100:00080000:2.0:1788390470.937775:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390470.937813:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 247 00000100:00100000:1.0:1788390470.937822:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:2407:x1875263088598016:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390470.937880:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:2407:x1875263088598016:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 59us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390470.941309:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 248 00000100:00100000:3.0:1788390470.941367:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2407:x1875263088598528:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:3.0:1788390470.941457:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2407:x1875263088598528:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 103us (4895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390470.941466:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 248 00000100:00100000:1.0:1788390470.944241:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 247 00000040:00080000:1.0:1788390470.994930:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788390471.250083:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098056704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390471.250163:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390471.250349:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098056704 00000100:00100000:3.0:1788390471.250357:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098056704 00000100:00100000:3.0:1788390471.250410:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788390471.250420:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098056704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788390471.250454:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788390471.251913:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098056704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1485us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390471.251925:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788390471.253786:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098056704:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788390471.825795:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390472.038008:0:15023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:07:50 (1788390470) 00010000:00010000:1.0:1788390472.851066:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390473.297946:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098056832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390473.298010:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390473.298068:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098056960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390473.298091:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390473.298179:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098056832 00000100:00100000:3.0:1788390473.298186:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098056832 00000100:00100000:3.0:1788390473.298234:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788390473.298242:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e878bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098056832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390473.298339:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788390473.298382:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e878bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098056832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390473.298396:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788390473.298417:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098056960 00000100:00100000:3.0:1788390473.298421:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098056960 00000100:00100000:3.0:1788390473.298442:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788390473.298448:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098056960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788390473.298467:0:7527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788390473.298496:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098056960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390473.298501:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1788390473.298514:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390473.298547:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098056960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390473.298571:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098056832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390473.300037:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098057088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390473.300078:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390473.300115:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098057088 00000100:00100000:3.0:1788390473.300120:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098057088 00000100:00100000:3.0:1788390473.300155:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788390473.300162:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098057088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390473.300176:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788390473.300210:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098057088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390473.300216:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1788390473.300232:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390473.300250:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788390473.300255:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984e88835180, transno 4294967323 00000004:00080000:3.0:1788390473.300588:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1788390473.300610:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098057088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390473.809935:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8825c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875263098057344:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.810006:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390473.810063:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1875263098057856:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.810086:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390473.810108:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098058368:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.810129:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390473.810152:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788390473.810157:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263098057216:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810395:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098057600:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810425:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390473.810445:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098058112:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810468:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390473.810485:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098058624:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810507:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390473.810523:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788390473.810529:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098057472:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810551:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390473.810570:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098057984:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810592:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390473.810623:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098058496:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810658:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390473.810689:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098057344 00000100:00100000:0.0:1788390473.810708:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098057344 00000100:00100000:0.0:1788390473.810746:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098057856 00000100:00100000:0.0:1788390473.810749:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098057856 00000100:00100000:0.0:1788390473.810771:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098058368 00000100:00100000:0.0:1788390473.810774:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098058368 00000100:00100000:0.0:1788390473.810785:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098057600 00000100:00100000:0.0:1788390473.810788:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098057600 00000100:00100000:0.0:1788390473.810797:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098057984 00000100:00100000:0.0:1788390473.810800:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098057984 00000100:00100000:0.0:1788390473.810826:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098058496 00000100:00100000:0.0:1788390473.810829:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098058496 00000100:00100000:0.0:1788390473.810847:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788390473.810856:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875263098057344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810898:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875263098057344:12345-0@lo:400:kworker.0 Request processed in 43us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.810905:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788390473.810922:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788390473.810928:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875263098057856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810952:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875263098057856:12345-0@lo:400:kworker.0 Request processed in 25us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.810958:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788390473.810970:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788390473.810975:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8885b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098058368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.810998:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8885b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875263098058368:12345-0@lo:400:kworker.0 Request processed in 23us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.811012:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788390473.811025:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788390473.811030:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098057600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.811059:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098057600:12345-0@lo:400:kworker.0 Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.811064:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788390473.811075:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788390473.811080:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098057984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.811101:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098057984:12345-0@lo:400:kworker.0 Request processed in 21us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.811106:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788390473.811116:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788390473.811122:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098058496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.811147:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098058496:12345-0@lo:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.811152:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788390473.811183:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098058112 00000100:00100000:0.0:1788390473.811187:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098058112 00000100:00100000:0.0:1788390473.811209:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098058624 00000100:00100000:0.0:1788390473.811212:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098058624 00000100:00100000:0.0:1788390473.811233:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788390473.811239:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098058112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.811268:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098058112:12345-0@lo:400:kworker.0 Request processed in 29us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.811274:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788390473.811293:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788390473.811299:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098058624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.811349:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098058624:12345-0@lo:400:kworker.0 Request processed in 50us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.811355:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788390473.811379:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098057472 00000100:00100000:0.0:1788390473.811383:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098057472 00000100:00100000:0.0:1788390473.811408:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788390473.811415:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098057472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.811446:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098057472:12345-0@lo:400:kworker.0 Request processed in 31us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.811451:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788390473.811492:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098057472:0@lo:400:kworker.0 00010000:00080000:0.0:1788390473.811506:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8884f100 x1875263098057984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390473.811517:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098057984:0@lo:400:kworker.0 00010000:00080000:0.0:1788390473.811526:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e883fe680 x1875263098058496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390473.811535:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098058496:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.811545:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098057600:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.811555:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098058112:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.811563:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098058624:0@lo:400:kworker.0 00000100:00080000:0.0:1788390473.811626:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390473.811635:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788390473.811637:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390473.811996:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390473.812033:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e879b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098057728:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.812059:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390473.812077:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098058240:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.812110:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390473.812130:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098058752:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.812151:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390473.813491:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390473.813510:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098058880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390473.813556:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390473.813633:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098058880 00000100:00100000:2.0:1788390473.813638:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098058880 00000100:00100000:2.0:1788390473.813683:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788390473.813691:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098058880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390473.813817:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8825c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875263098057344:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.813830:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1875263098057856:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.813841:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3623:1875263098058368:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.813869:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098057728 00000100:00100000:3.0:1788390473.813873:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098057728 00000100:00100000:3.0:1788390473.813899:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788390473.813905:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098057728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.813960:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098057728:12345-0@lo:400:kworker.0 Request processed in 54us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390473.813967:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788390473.813988:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098058240 00000100:00100000:3.0:1788390473.813991:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098058240 00000100:00100000:3.0:1788390473.814012:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098058752 00000100:00100000:3.0:1788390473.814015:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098058752 00000100:00100000:3.0:1788390473.814031:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788390473.814036:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098058240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.814066:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098058240:12345-0@lo:400:kworker.0 Request processed in 29us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390473.814071:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788390473.814082:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788390473.814087:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098058752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.814113:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098058752:12345-0@lo:400:kworker.0 Request processed in 27us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390473.814118:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788390473.814151:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e879b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098057728:0@lo:400:kworker.0 00000100:00100000:3.0:1788390473.814162:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098058240:0@lo:400:kworker.0 00002000:00000024:2.0:1788390473.814434:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390473.814472:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098058880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 781us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390473.814478:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788390473.814502:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098059008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390473.814528:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390473.814558:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098059008 00000100:00100000:2.0:1788390473.814561:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098059008 00000100:00100000:2.0:1788390473.814584:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788390473.814591:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098059008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788390473.814599:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390473.814632:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f85ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098059008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390473.814637:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1788390473.814650:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390473.814669:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098059008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390473.814690:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098058880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390473.815611:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098057216 00000100:00100000:0.0:1788390473.815618:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098057216 00000100:00100000:3.0:1788390473.817190:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098058752:0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.817302:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788390473.817316:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3623:x1875263098057216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390473.817481:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3623:x1875263098057216:12345-0@lo:400:kworker.0 Request processed in 170us (5485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.817489:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788390473.817564:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263098057216:0@lo:400:kworker.0 00010000:00010000:2.0:1788390473.873408:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390473.907098:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390473.908601:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088598912 00000100:00100000:1.0:1788390473.908615:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088598912 00000100:00100000:1.0:1788390473.908751:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 66 00000100:00100000:1.0:1788390473.908762:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:13203:x1875263088598912:12345-192.168.202.11@tcp:35:umount.0 00000100:00100000:1.0:1788390473.909192:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:13203:x1875263088598912:12345-192.168.202.11@tcp:35:umount.0 Request processed in 432us (2103us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788390473.909200:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 66 00000100:00080000:2.0:1788390473.909725:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788390473.911561:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:3.0:1788390473.911576:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788390473.912953:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788390473.912971:0:6524:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788390473.917763:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390473.917838:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088599168 00000100:00100000:1.0:1788390473.917861:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088599168 00000100:00100000:1.0:1788390473.917931:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00100000:1.0:1788390473.917942:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+18:13203:x1875263088599168:12345-192.168.202.11@tcp:35:umount.0 00000100:00100000:1.0:1788390473.918248:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:13203:x1875263088599168:12345-192.168.202.11@tcp:35:umount.0 Request processed in 306us (492us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788390473.918256:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 67 00000100:00100000:0.0:1788390473.928939:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390473.929021:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088599424 00000100:00100000:1.0:1788390473.929031:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088599424 00000100:00100000:1.0:1788390473.929139:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:1.0:1788390473.929151:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb604e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+19:13203:x1875263088599424:12345-192.168.202.11@tcp:35:umount.0 00000100:00100000:1.0:1788390473.929405:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb604e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:13203:x1875263088599424:12345-192.168.202.11@tcp:35:umount.0 Request processed in 256us (474us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788390473.929413:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 68 00000100:00100000:0.0:1788390473.931971:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390473.932047:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088599680 00000100:00100000:3.0:1788390473.932067:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088599680 00000100:00100000:3.0:1788390473.932129:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 69 00000100:00100000:3.0:1788390473.932141:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:13203:x1875263088599680:12345-192.168.202.11@tcp:35:umount.0 00000100:00100000:3.0:1788390473.932446:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:13203:x1875263088599680:12345-192.168.202.11@tcp:35:umount.0 Request processed in 305us (490us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788390473.932453:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 69 00000100:00100000:3.0:1788390473.938456:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390473.938491:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390473.938508:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390473.938526:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390473.938549:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088599936 00000100:00100000:3.0:1788390473.938557:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088599936 00000100:00100000:3.0:1788390473.938594:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088600192 00000100:00100000:3.0:1788390473.938596:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088600192 00000100:00100000:3.0:1788390473.938602:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088600064 00000100:00100000:3.0:1788390473.938603:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088600064 00000100:00100000:3.0:1788390473.938612:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 20 00000100:00100000:3.0:1788390473.938618:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+15:2406:x1875263088599936:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390473.938635:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390473.938651:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d4e00/0xe156d0713be9765b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c81 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390473.938664:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390473.938700:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+14:2406:x1875263088599936:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390473.938704:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 20 00000100:00100000:3.0:1788390473.938715:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:3.0:1788390473.938719:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+13:2406:x1875263088600192:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390473.938735:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390473.938741:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a81a00/0xe156d0713be978a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d5a expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390473.938746:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390473.938757:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+12:2406:x1875263088600192:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 38us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390473.938761:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:3.0:1788390473.938768:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:3.0:1788390473.938771:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+11:2406:x1875263088600064:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390473.938776:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390473.938780:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d4200/0xe156d0713be9759e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c42 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390473.938785:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390473.938793:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2406:x1875263088600064:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 22us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390473.938796:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:0.0:1788390473.938927:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088599808 00000100:00100000:0.0:1788390473.938932:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088599808 00000100:00100000:0.0:1788390473.939051:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 80 00000100:00100000:0.0:1788390473.939059:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2403:x1875263088599808:12345-192.168.202.11@tcp:9:umount.0 00000020:00000080:0.0:1788390473.939081:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97979 00000100:00080000:0.0:1788390473.939089:0:8409:0:(import.c:65:import_set_state_nolock()) ffff984e88233800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788390473.939132:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788390473.939137:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788390473.939270:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+2:2403:x1875263088599808:12345-192.168.202.11@tcp:9:umount.0 Request processed in 213us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.939275:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 80 00000100:00080000:2.0:1788390473.939526:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390473.942234:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390473.942505:0:8798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088600576 00000100:00100000:0.0:1788390473.942514:0:8798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088600576 00000100:00100000:0.0:1788390473.942603:0:8798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 81 00000100:00100000:0.0:1788390473.942609:0:8798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+7:2403:x1875263088600576:12345-192.168.202.11@tcp:9:umount.0 00000020:00000080:0.0:1788390473.942644:0:8798:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97be8 00000020:00010000:0.0:1788390473.942649:0:8798:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984f90ebb800: total 0 00000100:00080000:0.0:1788390473.942652:0:8798:0:(import.c:65:import_set_state_nolock()) ffff984f90eba000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788390473.942694:0:8798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788390473.942831:0:8798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2403:x1875263088600576:12345-192.168.202.11@tcp:9:umount.0 Request processed in 222us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390473.942837:0:8798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 81 00000020:00010000:1.0:1788390473.942978:0:13157:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984f90ebb800: total 0 00010000:00010000:1.0:1788390473.943011:0:13157:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984f90ebb800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788390473.943050:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e20e3ca8/0xe156d0713be97fa7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f44 expref: 4 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.943072:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b5a2d6/0xe156d0713be98676 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244127 expref: 3 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.943082:0:13157:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984f90ebb800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788390473.943089:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390473.943090:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390473.943091:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788390473.943545:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390473.948271:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390473.948363:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088601600 00000100:00100000:0.0:1788390473.948373:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088601600 00000100:00100000:0.0:1788390473.948423:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 257 00000100:00100000:0.0:1788390473.948432:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+21:2403:x1875263088601600:12345-192.168.202.11@tcp:39:umount.0 00000020:00000080:0.0:1788390473.948461:0:6494:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be975ac 00000020:00010000:0.0:1788390473.948477:0:6494:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984fbb3ba800: total 0 00000100:00080000:0.0:1788390473.948481:0:6494:0:(import.c:65:import_set_state_nolock()) ffff984e85f72000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788390473.948503:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788390473.948647:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+20:2403:x1875263088601600:12345-192.168.202.11@tcp:39:umount.0 Request processed in 215us (385us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788390473.948654:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 257 00000020:00010000:1.0:1788390473.948753:0:13156:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984fbb3ba800: total 0 00010000:00010000:1.0:1788390473.948798:0:13156:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984fbb3ba800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788390473.948839:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390473.948843:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390473.948850:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1800/0xe156d0713be98637 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244112 expref: 19 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.948865:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390473.948868:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788390473.948871:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5000/0xe156d0713be98661 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244120 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.948883:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:1.0:1788390473.948885:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788390473.948888:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f80030600/0xe156d0713be9794f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d84 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.948901:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:1.0:1788390473.948903:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390473.948907:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cec00/0xe156d0713be98319 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244040 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.948918:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863800) 00010000:00010000:1.0:1788390473.948920:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390473.948923:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98010 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f60 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.948934:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984f86567700) 00010000:00010000:1.0:1788390473.948947:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390473.948951:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be978f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d6f expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.949002:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:1.0:1788390473.949005:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390473.949009:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81e00/0xe156d0713be97f68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f2f expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.949020:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:1.0:1788390473.949022:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788390473.949026:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80400/0xe156d0713be97f92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f3d expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.949037:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff984fb7868b00) 00010000:00010000:1.0:1788390473.949039:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390473.949042:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f8a5cea00/0xe156d0713be97c4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243e5d expref: 11 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.949054:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff984fb785f900) 00010000:00010000:1.0:1788390473.949056:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390473.949060:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4800/0xe156d0713be98557 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2440da expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.949072:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff984fb7863100) 00010000:00010000:1.0:1788390473.949074:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788390473.949078:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e87ba1400/0xe156d0713be9802c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243f67 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.949101:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff984fba803300) 00010000:00010000:1.0:1788390473.949104:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390473.949107:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be97e88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243ef7 expref: 8 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.949120:0:13156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984fba803200) 00010000:00010000:1.0:1788390473.949123:0:13156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390473.949127:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5200/0xe156d0713be978d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d68 expref: 7 pid: 12122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390473.949139:0:13156:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984fbb3ba800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788390473.949151:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390473.949153:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390473.949154:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390473.956009:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390473.956107:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088601728 00000100:00100000:3.0:1788390473.956117:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088601728 00000100:00080000:2.0:1788390473.956230:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390473.956268:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 258 00000100:00100000:3.0:1788390473.956276:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+5:2403:x1875263088601728:12345-192.168.202.11@tcp:39:umount.0 00000020:00000080:3.0:1788390473.956301:0:6493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be975b3 00000100:00080000:3.0:1788390473.956313:0:6493:0:(import.c:65:import_set_state_nolock()) ffff984e876b9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390473.956356:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788390473.956510:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f86efe9-6df9-4a09-8c7c-860d5e3f89aa+3:2403:x1875263088601728:12345-192.168.202.11@tcp:39:umount.0 Request processed in 235us (509us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788390473.956516:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 258 00010000:00010000:2.0:1788390473.956720:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390474.747908:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390474.748059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390474.748941:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088601856 00000100:00100000:3.0:1788390474.749011:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088601856 00000100:00100000:0.0:1788390474.749171:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390474.754534:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088601984 00000100:00100000:1.0:1788390474.754550:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088601984 00000100:00100000:1.0:1788390474.754610:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088602112 00000100:00100000:1.0:1788390474.754614:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088602112 00000100:00100000:1.0:1788390474.754638:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00100000:1.0:1788390474.754647:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+12:2405:x1875263088601856:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390474.754662:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390474.754685:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d4c00/0xe156d0713be976af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c96 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390474.754702:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390474.754774:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+11:2405:x1875263088601856:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 127us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390474.754811:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00100000:1.0:1788390474.754866:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:1.0:1788390474.754873:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+10:2405:x1875263088601984:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390474.754881:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390474.754890:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d5600/0xe156d0713be976b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243cc7 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390474.754899:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390474.754917:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+9:2405:x1875263088601984:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 44us (6859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390474.754924:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:1.0:1788390474.754937:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:1.0:1788390474.754944:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+8:2406:x1875263088602112:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390474.754952:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390474.754959:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a80c00/0xe156d0713be978a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243d53 expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390474.754968:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390474.754983:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ec441e1-c819-43bb-9906-f4af85d85a23+7:2406:x1875263088602112:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 40us (5815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390474.754989:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:1.0:1788390474.755072:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390474.755400:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088602368 00000100:00100000:1.0:1788390474.755405:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088602368 00000100:00100000:1.0:1788390474.755454:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 259 00000100:00100000:1.0:1788390474.755462:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+6:2403:x1875263088602368:12345-192.168.202.11@tcp:39:umount.0 00000020:00000080:1.0:1788390474.755501:0:6492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be976c4 00000020:00010000:1.0:1788390474.755509:0:6492:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984fc18b5000: total 0 00000100:00080000:1.0:1788390474.755513:0:6492:0:(import.c:65:import_set_state_nolock()) ffff984fc18b3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788390474.755533:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788390474.755657:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2403:x1875263088602368:12345-192.168.202.11@tcp:39:umount.0 Request processed in 195us (584us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788390474.755664:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 259 00000020:00010000:1.0:1788390474.755680:0:6481:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984fc18b5000: total 0 00010000:00010000:1.0:1788390474.755724:0:6481:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984fc18b5000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788390474.755748:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863800) 00010000:00010000:1.0:1788390474.755751:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390474.755757:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4400/0xe156d0713be98684 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24412e expref: 4 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390474.755776:0:6481:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984fc18b5000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788390474.755786:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390474.755788:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390474.755789:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788390474.756281:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390474.763035:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390474.763164:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088602496 00000100:00100000:3.0:1788390474.763174:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088602496 00000100:00100000:3.0:1788390474.763265:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 260 00000100:00100000:3.0:1788390474.763275:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+5:2403:x1875263088602496:12345-192.168.202.11@tcp:39:umount.0 00000020:00000080:3.0:1788390474.763311:0:8996:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be976cb 00000100:00080000:3.0:1788390474.763351:0:8996:0:(import.c:65:import_set_state_nolock()) ffff984e87a78800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390474.763376:0:8996:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788390474.763525:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5+3:2403:x1875263088602496:12345-192.168.202.11@tcp:39:umount.0 Request processed in 250us (498us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788390474.763532:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 260 00010000:00010000:2.0:1788390474.763706:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788390474.763904:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390474.785865:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390474.787309:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088602752 00000100:00100000:2.0:1788390474.787367:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088602752 00000100:00100000:2.0:1788390474.787440:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 373 00000100:00100000:2.0:1788390474.787450:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+7:2403:x1875263088602752:12345-192.168.202.11@tcp:251:umount.0 00000020:00000080:2.0:1788390474.787494:0:6484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97589 00000020:00010000:2.0:1788390474.787503:0:6484:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984fc19e0000: total 0 00000100:00080000:2.0:1788390474.787508:0:6484:0:(import.c:65:import_set_state_nolock()) ffff984fc19e5800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788390474.787586:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ec441e1-c819-43bb-9906-f4af85d85a23+3:2403:x1875263088602752:12345-192.168.202.11@tcp:251:umount.0 Request processed in 137us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390474.787594:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 373 00000020:00010000:0.0:1788390474.787916:0:13156:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984fc19e0000: total 0 00010000:00010000:0.0:1788390474.787921:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390474.787982:0:13156:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984fc19e0000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788390474.788018:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf735a00/0xe156d0713be97662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e243c88 expref: 2 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390474.788033:0:13156:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984fc19e0000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788390474.788062:0:13156:0:(genops.c:885:class_export_put()) final put ffff984fc19e0000/5ec441e1-c819-43bb-9906-f4af85d85a23 00010000:00010000:0.0:1788390474.788081:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390474.788083:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390474.788085:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788390474.788224:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc19e0000/5ec441e1-c819-43bb-9906-f4af85d85a23 for MGS 00000020:00000080:1.0:1788390474.788264:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc19e5800 for MGS 00010000:00010000:3.0:1788390474.898228:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390475.921715:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788390475.989850:0:15217:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788390476.005846:0:15217:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788390476.005904:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.005920:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.005928:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.005936:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.005958:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788390476.005963:0:15217:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788390476.005986:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390476.005990:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788390476.005996:0:15217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788390476.006022:0:15217:0:(import.c:65:import_set_state_nolock()) ffff984f894ec800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788390476.006074:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263098059136:0@lo:39:umount.0 00010000:00010000:2.0:1788390476.006092:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390476.006099:0:13157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.006123:0:13157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80030400 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390476.006127:0:13157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.006136:0:13157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390476.006143:0:13157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390476.006150:0:13157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788390476.006152:0:13157:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788390476.006155:0:13157:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788390476.006183:0:13157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.006191:0:13157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390476.006216:0:13157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.006223:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f80030400/0xe156d0713be97631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97638 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390476.006234:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390476.006237:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390476.006240:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390476.006242:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390476.006249:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390476.006263:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098059264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390476.006301:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390476.006468:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098059264 00000100:00100000:1.0:1788390476.006476:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098059264 00000100:00100000:3.0:1788390476.006516:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098059136 00000100:00100000:3.0:1788390476.006521:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098059136 00000100:00100000:3.0:1788390476.006557:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788390476.006566:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788390476.006568:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875263098059136:12345-0@lo:39:umount.0 00000100:00100000:1.0:1788390476.006579:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+24:3624:x1875263098059264:12345-0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788390476.006595:0:6493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be971a0 00010000:00010000:1.0:1788390476.006599:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1788390476.006602:0:6493:0:(import.c:65:import_set_state_nolock()) ffff984f863f8800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788390476.006618:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf734a00/0xe156d0713be97638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97631 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.006631:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390476.006664:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3621:x1875263098059136:12345-0@lo:39:umount.0 Request processed in 99us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390476.006672:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788390476.006681:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3624:x1875263098059264:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390476.006690:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:3.0:1788390476.006691:0:6493:0:(genops.c:885:class_export_put()) final put ffff984f863fe000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788390476.006717:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390476.006910:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098059264:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788390476.007041:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f863fe000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788390476.007082:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984f863f8800 for lustre-MDT0000 00000100:00080000:3.0:1788390476.007108:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f894ec800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788390476.007121:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263098059136:0@lo:39:umount.0 00000100:00080000:0.0:1788390476.007141:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390476.007145:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788390476.007149:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788390476.008484:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008499:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008519:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008525:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008546:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390476.008553:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008559:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008565:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008571:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008623:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788390476.008630:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008637:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008643:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.008661:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009292:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788390476.009312:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009349:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390476.009353:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009362:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390476.009370:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390476.009375:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788390476.009378:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788390476.009416:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009422:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390476.009460:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009467:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f846d4000/0xe156d0713be9763f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97646 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009482:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390476.009485:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009491:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390476.009494:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009500:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390476.009506:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390476.009510:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788390476.009513:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788390476.009514:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788390476.009528:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009534:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390476.009539:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009545:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be97543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9754a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009566:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390476.009570:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009576:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80800 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390476.009579:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009585:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390476.009592:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390476.009597:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788390476.009599:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788390476.009614:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009619:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390476.009634:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009640:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390476.009642:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390476.009644:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390476.009655:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390476.009672:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098059648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390476.009735:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390476.009811:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098059648 00000100:00100000:1.0:1788390476.009818:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098059648 00000100:00100000:1.0:1788390476.009866:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390476.009876:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3625:x1875263098059648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390476.009888:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390476.009902:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf63d000/0xe156d0713be97899 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97892 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.009916:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390476.009953:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+22:3625:x1875263098059648:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390476.009959:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390476.010002:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098059648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390476.010085:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098059392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390476.010115:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390476.010144:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390476.010150:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098059520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390476.010171:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390476.010223:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098059392 00000100:00100000:1.0:1788390476.010228:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098059392 00000100:00100000:1.0:1788390476.010291:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098059520 00000100:00100000:1.0:1788390476.010295:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098059520 00000100:00100000:2.0:1788390476.010385:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390476.010394:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+23:3622:x1875263098059392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390476.010402:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390476.010412:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf735600/0xe156d0713be97646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be9763f expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.010423:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390476.010453:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+22:3622:x1875263098059392:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390476.010459:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390476.010473:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788390476.010479:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+21:3622:x1875263098059520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390476.010487:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390476.010494:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b4200/0xe156d0713be9754a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97543 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.010503:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390476.010526:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+20:3622:x1875263098059520:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390476.010531:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788390476.010556:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098059520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390476.010564:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098059392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390476.010706:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390476.010767:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390476.010775:0:15217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be97892 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97899 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390476.010795:0:15217:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788390476.010804:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.010812:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.010819:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390476.010825:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.010853:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390476.010859:0:13157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.010866:0:13157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cec00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390476.010869:0:13157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.010877:0:13157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390476.010884:0:13157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390476.010889:0:13157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788390476.010892:0:13157:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1788390476.010909:0:13157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.010915:0:13157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390476.010940:0:13157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390476.010950:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390476.010951:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390476.010953:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390476.010965:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390476.010976:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098059776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390476.011013:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390476.011074:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390476.011079:0:15217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f8a5cec00/0xe156d0713be970ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97106 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390476.011088:0:15217:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1788390476.011092:0:15217:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788390476.011094:0:15217:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788390476.011127:0:15217:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788390476.011131:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788390476.011142:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390476.011147:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788390476.011153:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff984fc18ff800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390476.011159:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff984e85f74000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390476.011163:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff984fbad79000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390476.011167:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff984fbad7b800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1788390476.011175:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff984fc18b5000 ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 192.168.202.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390476.011180:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff984fbb3ba800 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 192.168.202.11@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:0.0:1788390476.011186:0:15217:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff984f89fc99b8) has exports, disconnecting them 00000020:00080000:0.0:1788390476.011190:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff984fc18ff800), last request at 1788390473 00000020:00000080:0.0:1788390476.011198:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be974b0 00000100:00080000:0.0:1788390476.011215:0:15217:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788390476.011246:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788390476.011381:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984fc18ff800): rc 0 00000020:00000080:0.0:1788390476.011385:0:15217:0:(genops.c:885:class_export_put()) final put ffff984fc18ff800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788390476.011396:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff984e85f74000), last request at 1788390473 00000020:00000080:0.0:1788390476.011401:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97391 00000100:00080000:0.0:1788390476.011407:0:15217:0:(import.c:65:import_set_state_nolock()) ffff984e85f70000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788390476.011450:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc18ff800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1788390476.011453:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098059776 00000100:00100000:1.0:1788390476.011459:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098059776 00000020:00000080:3.0:1788390476.011493:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc18fe800 for lustre-MDT0000 00000100:00100000:1.0:1788390476.011497:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390476.011508:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984faef68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+20:3624:x1875263098059776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390476.011518:0:10369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390476.011529:0:10369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80031400/0xe156d0713be97106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be970ff expref: 20 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390476.011539:0:10369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390476.011576:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984faef68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3624:x1875263098059776:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390476.011583:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390476.011603:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098059776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390476.011732:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788390476.011816:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984e85f74000): rc 0 00000020:00000080:0.0:1788390476.011819:0:15217:0:(genops.c:885:class_export_put()) final put ffff984e85f74000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788390476.011859:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff984fbad79000), last request at 1788390307 00000020:00000080:0.0:1788390476.011863:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97287 00000100:00080000:0.0:1788390476.011867:0:15217:0:(import.c:65:import_set_state_nolock()) ffff984fbad7c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788390476.011914:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984fbad79000): rc 0 00000020:00000080:0.0:1788390476.011917:0:15217:0:(genops.c:885:class_export_put()) final put ffff984fbad79000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788390476.011937:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984e85f74000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788390476.011970:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e85f70000 for lustre-MDT0000 00000020:00080000:0.0:1788390476.012008:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff984fbad7b800), last request at 1788390306 00000020:00000080:0.0:1788390476.012012:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97248 00000100:00080000:0.0:1788390476.012022:0:15217:0:(import.c:65:import_set_state_nolock()) ffff984fbad7a000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788390476.012048:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbad79000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788390476.012073:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fbad7c800 for lustre-MDT0000 00010000:00010000:3.0:1788390476.014816:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390476.014891:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788390476.014965:0:15217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:0.0:1788390476.015054:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984fbad7b800): rc 0 00000004:00000080:0.0:1788390476.015062:0:15217:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4a7c8597ae0 00000100:00080000:0.0:1788390476.015082:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788390476.015086:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788390476.015843:0:15217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788390476.015869:0:15217:0:(import.c:65:import_set_state_nolock()) ffff984f8a4f2800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788390476.015919:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098059904:0@lo:39:umount.0 00000100:00100000:3.0:1788390476.015990:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390476.016101:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098059904 00000100:00100000:3.0:1788390476.016109:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098059904 00000100:00080000:0.0:1788390476.016154:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788390476.016159:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00100000:3.0:1788390476.016165:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000004:00080000:0.0:1788390476.016173:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390476.016178:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875263098059904:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788390476.016212:0:7527:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be972e2 00000100:00080000:3.0:1788390476.016220:0:7527:0:(import.c:65:import_set_state_nolock()) ffff984fbaf13000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788390476.016284:0:15217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788390476.016294:0:15217:0:(import.c:65:import_set_state_nolock()) ffff984f88c45000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788390476.016610:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098060032:0@lo:9:umount.0 00000100:00100000:2.0:1788390476.016661:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390476.016701:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788390476.016703:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1788390476.016713:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788390476.017471:0:15217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788390476.017486:0:15217:0:(import.c:65:import_set_state_nolock()) ffff984fc19ab800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788390476.017557:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098060160:0@lo:9:umount.0 00000001:00000004:3.0:1788390476.017588:0:7527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788390476.017596:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390476.017635:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098060032 00000100:00100000:2.0:1788390476.017641:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098060032 00000100:00100000:2.0:1788390476.017683:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098060160 00000100:00100000:2.0:1788390476.017686:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098060160 00000100:00100000:2.0:1788390476.017704:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788390476.017711:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875263098060032:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788390476.017727:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97432 00000100:00100000:3.0:1788390476.017728:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3621:x1875263098059904:12345-0@lo:39:umount.0 Request processed in 1551us (1736us total) trans 4294967301 rc 0/0 00000100:00080000:2.0:1788390476.017732:0:8409:0:(import.c:65:import_set_state_nolock()) ffff984fc18fd000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788390476.017739:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000001:00000004:2.0:1788390476.017765:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788390476.017778:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788390476.017797:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875263098060160:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788390476.017812:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97574 00000100:00080000:3.0:1788390476.017819:0:8408:0:(import.c:65:import_set_state_nolock()) ffff984fc18f8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390476.017867:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788390476.017867:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3621:x1875263098060032:12345-0@lo:9:umount.0 Request processed in 156us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390476.017876:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000020:00080000:0.0:1788390476.017953:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff984f89fc99b8) has no exports 00000100:00100000:3.0:1788390476.017955:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3621:x1875263098060160:12345-0@lo:9:umount.0 Request processed in 158us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390476.017963:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788390476.018012:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc19ab800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788390476.018036:0:3621:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788390476.018043:0:3621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390476.018048:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098060160:0@lo:9:umount.0 00000100:00080000:3.0:1788390476.018063:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f88c45000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788390476.018081:0:3621:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788390476.018084:0:3621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390476.018088:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098060032:0@lo:9:umount.0 00010000:00010000:1.0:1788390476.018091:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788390476.018101:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390476.018104:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f8a4f2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788390476.018107:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390476.018111:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098059904:0@lo:39:umount.0 00010000:00010000:3.0:1788390476.018135:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390476.018140:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390476.018146:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788390476.024779:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff984f89fc99b8) has no exports 00000020:00000080:0.0:1788390476.054531:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9715a 00000020:00000080:0.0:1788390476.054546:0:15217:0:(genops.c:885:class_export_put()) final put ffff984fb76a1800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788390476.054614:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788390476.054692:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb76a1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788390476.054740:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390476.054752:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788390476.054756:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff984f85aecd28) has no exports 00000020:00000080:1.0:1788390476.054982:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97153 00000020:00000080:1.0:1788390476.054989:0:15217:0:(genops.c:885:class_export_put()) final put ffff984fb767e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788390476.055055:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb767e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788390476.055128:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390476.055135:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788390476.055137:0:15217:0:(genops.c:885:class_export_put()) final put ffff984fb767b800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788390476.055139:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb767b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788390476.055147:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1788390476.371619:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390476.371638:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098060288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788390476.371704:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390476.371736:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098060288 00000100:00100000:3.0:1788390476.371743:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098060288 00000100:00100000:3.0:1788390476.371793:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788390476.371800:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3623:x1875263098060288:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788390476.371806:0:6497:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788390476.371861:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3623:x1875263098060288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (156us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788390476.371867:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:02020000:1.0:1788390476.371912:0:3623:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788390476.379199:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788390476.379208:0:3623:0:(import.c:65:import_set_state_nolock()) ffff984fbac02800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788390476.379213:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788390476.389346:0:3623:0:(import.c:65:import_set_state_nolock()) ffff984fbac02800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390476.389361:0:3623:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 127 00000100:00080000:1.0:1788390476.389372:0:3623:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff984fbac02800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390476.389445:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88821500 x1875263098060416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390476.389768:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098060416:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788390476.389983:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390476.390311:0:7527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098060416 00000100:00100000:1.0:1788390476.390318:0:7527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098060416 00000100:00100000:1.0:1788390476.390395:0:7527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788390476.390404:0:7527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1875263098060416:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788390476.390421:0:7527:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788390476.396744:0:7527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1875263098060416:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 6328us (6749us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788390476.396761:0:7527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1788390476.396861:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fbac02800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390476.396867:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788390476.396871:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098060416:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1788390476.946347:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390477.969760:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390478.419569:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390478.419595:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098060544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390478.419673:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390478.419828:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098060544 00000100:00100000:3.0:1788390478.419837:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098060544 00000100:00100000:3.0:1788390478.419907:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788390478.419918:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098060544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390478.419951:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788390478.419998:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098060544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390478.420005:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788390478.420032:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390478.431971:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098060544:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788390478.929502:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788390478.929524:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788390478.929528:0:36:0:(import.c:65:import_set_state_nolock()) ffff984fbac02800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390478.929535:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 296 00000100:00080000:0.0:1788390478.929541:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788390478.929549:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff984fbac02800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390478.929570:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098060672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788390478.929575:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88b23480 x1875263098060928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390478.929639:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098060928:0@lo:38:kworker.0 00000100:00100000:3.0:1788390478.929648:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390478.929674:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390478.929728:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390478.929736:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098060800:0@lo:400:kworker.0 00000100:00100000:3.0:1788390478.929787:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390478.929822:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098060928 00000100:00100000:3.0:1788390478.929828:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098061312:0@lo:400:kworker.0 00000100:00100000:0.0:1788390478.929828:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098060928 00000100:00100000:3.0:1788390478.929860:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390478.929880:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788390478.929881:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390478.929890:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1875263098060928:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788390478.929891:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098061440:0@lo:400:kworker.0 00000100:00100000:1.0:1788390478.929910:0:10071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098060672 00010000:02000000:0.0:1788390478.929912:0:6498:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788390478.929917:0:10071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098060672 00000100:00100000:3.0:1788390478.929925:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390478.929975:0:10071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788390478.929977:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098060800 00000100:00100000:3.0:1788390478.929983:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098060800 00000100:00100000:1.0:1788390478.929987:0:10071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098060672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788390478.930016:0:10071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788390478.930022:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788390478.930032:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3624:x1875263098060800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390478.930069:0:10071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098060672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390478.930079:0:10071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788390478.930080:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f87ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13bece9d-37f8-46e7-9f27-a320529bc20d+19:3624:x1875263098060800:12345-0@lo:400:kworker.0 Request processed in 47us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390478.930089:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788390478.930106:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098061312 00000100:00100000:1.0:1788390478.930111:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098061312 00000100:00080000:3.0:1788390478.930126:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788390478.930132:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390478.930148:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788390478.930156:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098061312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390478.930180:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098061440 00000100:00100000:3.0:1788390478.930185:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098061440 00000100:00100000:1.0:1788390478.930190:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098061312:12345-0@lo:400:kworker.0 Request processed in 33us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390478.930196:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788390478.930221:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788390478.930229:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098061440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390478.930236:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098061056:0@lo:400:kworker.0 00000100:00100000:3.0:1788390478.930269:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098061440:12345-0@lo:400:kworker.0 Request processed in 41us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390478.930279:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788390478.930280:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390478.930494:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098061568:0@lo:400:kworker.0 00000100:00100000:1.0:1788390478.930518:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390478.930540:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788390478.930546:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098061184:0@lo:400:kworker.0 00000100:00100000:1.0:1788390478.930568:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390478.930594:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098061696:0@lo:400:kworker.0 00000100:00100000:1.0:1788390478.930616:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390478.930652:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098061440:0@lo:400:kworker.0 00010000:00080000:1.0:1788390478.930665:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88b21f80 x1875263098061312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390478.930674:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098061312:0@lo:400:kworker.0 00000100:00100000:1.0:1788390478.930682:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13bece9d-37f8-46e7-9f27-a320529bc20d:3624:1875263098060800:0@lo:400:kworker.0 00000100:00100000:1.0:1788390478.930695:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098060672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390478.931528:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098061056 00000100:00100000:1.0:1788390478.931533:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098061568 00000100:00100000:3.0:1788390478.931536:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098061056 00000100:00100000:1.0:1788390478.931538:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098061568 00000100:00100000:1.0:1788390478.931569:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098061184 00000100:00100000:1.0:1788390478.931571:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098061184 00000100:00100000:3.0:1788390478.931578:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098061696 00000100:00100000:3.0:1788390478.931584:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098061696 00000100:00100000:1.0:1788390478.931594:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788390478.931600:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1875263098061568:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788390478.931606:0:12122:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788390478.931610:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788390478.931619:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1875263098061056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390478.931628:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000020:00080000:2.0:1788390478.931629:0:6494:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788390478.931641:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098061696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390478.931649:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1875263098061568:12345-0@lo:400:kworker.0 Request processed in 48us (1130us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788390478.931655:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788390478.931674:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1875263098061056:12345-0@lo:400:kworker.0 Request processed in 53us (1394us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788390478.931680:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788390478.931687:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1875263098061184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390478.931691:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788390478.931693:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098061696:12345-0@lo:400:kworker.0 Request processed in 50us (1071us total) trans 0 rc 0/0 00000020:00080000:1.0:1788390478.931696:0:12122:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788390478.931705:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788390478.931725:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1875263098061184:12345-0@lo:400:kworker.0 Request processed in 38us (1156us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788390478.931731:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1788390478.931736:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390478.931819:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788390478.931824:0:3622:0:(import.c:65:import_set_state_nolock()) ffff984e85f76000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788390478.931828:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788390478.934227:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1875263098060928:12345-0@lo:38:kworker.0 Request processed in 4334us (4550us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390478.934238:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788390478.934483:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fbac02800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788390478.934490:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788390478.934507:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098060928:0@lo:38:kworker.0 00000100:00080000:1.0:1788390478.944057:0:3622:0:(import.c:65:import_set_state_nolock()) ffff984e85f76000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390478.944069:0:3622:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 148 00000100:00080000:1.0:1788390478.944079:0:3622:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff984e85f76000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390478.944120:0:3622:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88821c00 x1875263098061824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390478.944160:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098061184:0@lo:400:kworker.0 00010000:00080000:1.0:1788390478.944197:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e88b23800 x1875263098061696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390478.944210:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098061696:0@lo:400:kworker.0 00000100:00100000:2.0:1788390478.944214:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1875263098061824:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788390478.944227:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788390478.944232:0:3622:0:(import.c:65:import_set_state_nolock()) ffff984fb791b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788390478.944235:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788390478.944239:0:3622:0:(import.c:65:import_set_state_nolock()) ffff984fb791b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390478.944243:0:3622:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 127 00000100:00080000:1.0:1788390478.944260:0:3622:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff984fb791b000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390478.944276:0:3622:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e87af5500 x1875263098061952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390478.944281:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390478.944295:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098061056:0@lo:400:kworker.0 00000100:00080000:1.0:1788390478.944309:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788390478.944313:0:3622:0:(import.c:65:import_set_state_nolock()) ffff984e876bc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788390478.944316:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788390478.944318:0:3622:0:(import.c:65:import_set_state_nolock()) ffff984e876bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390478.944346:0:3622:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 167 00000100:00080000:1.0:1788390478.944349:0:3622:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff984e876bc000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390478.944363:0:3622:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e86bd6680 x1875263098062080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390478.944375:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098061568:0@lo:400:kworker.0 00000100:00100000:2.0:1788390478.944412:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875263098061952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788390478.944459:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390478.944516:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263098062080:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788390478.944538:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390478.944573:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098061824 00000100:00100000:0.0:1788390478.944573:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098061952 00000100:00100000:3.0:1788390478.944579:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098061824 00000100:00100000:0.0:1788390478.944579:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098061952 00000100:00100000:0.0:1788390478.944619:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788390478.944624:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788390478.944626:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875263098061952:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788390478.944634:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f86377050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263098061824:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788390478.944642:0:6494:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1788390478.944642:0:6493:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788390478.944674:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f86377050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263098061824:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 38us (396us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390478.944674:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875263098061952:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 48us (213us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788390478.944681:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788390478.944683:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1788390478.946193:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e85f76000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788390478.946201:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788390478.946206:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1875263098061824:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788390478.946225:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fb791b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788390478.946228:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788390478.946231:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875263098061952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788390478.946302:0:12122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098062080 00000100:00100000:1.0:1788390478.946307:0:12122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098062080 00000100:00100000:1.0:1788390478.946354:0:12122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788390478.946361:0:12122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3621:x1875263098062080:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788390478.946376:0:12122:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788390478.946434:0:12122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3621:x1875263098062080:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 67us (1890us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788390478.946441:0:12122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1788390478.946470:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e876bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788390478.946475:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788390478.946477:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263098062080:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788390478.994969:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788390479.444679:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788390479.444688:0:6471:0:(genops.c:885:class_export_put()) final put ffff984fbad7b800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788390479.444715:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000001:00080000:0.0:1788390479.444724:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788390479.444736:0:6471:0:(genops.c:885:class_export_put()) final put ffff984fc18b5000/ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000001:00100000:0.0:1788390479.444742:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000001:00080000:0.0:1788390479.444746:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788390479.444767:0:6471:0:(genops.c:885:class_export_put()) final put ffff984fbb3ba800/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:2.0:1788390479.444820:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbad7b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788390479.444880:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc18b5000/ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 for lustre-MDT0000 00000020:00000080:2.0:1788390479.444904:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbb3ba800/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa for lustre-MDT0000 00000020:00000080:2.0:1788390479.444934:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fbad7a000 for lustre-MDT0000 00000020:00000080:2.0:1788390479.444938:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc18b3000 for lustre-MDT0000 00000020:00000080:2.0:1788390479.444942:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e85f72000 for lustre-MDT0000 00000001:00100000:1.0:1788390479.445077:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788390479.445081:0:8402:0:(genops.c:885:class_export_put()) final put ffff984f88c41800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788390479.445100:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:1.0:1788390479.445109:0:8402:0:(genops.c:885:class_export_put()) final put ffff984f90ebb800/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:0.0:1788390479.445164:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984f88c41800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788390479.445194:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984f90ebb800/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa for lustre-OST0000 00000020:00000080:0.0:1788390479.445217:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc18fd000 for lustre-OST0000 00000020:00000080:0.0:1788390479.445220:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984f90eba000 for lustre-OST0000 00000001:00100000:3.0:1788390479.446124:0:7423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788390479.446135:0:7423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788390479.446139:0:7423:0:(genops.c:885:class_export_put()) final put ffff984fb7919000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788390479.446158:0:7423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000001:00080000:3.0:1788390479.446162:0:7423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788390479.446164:0:7423:0:(genops.c:885:class_export_put()) final put ffff984e87a7f000/ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 00000001:00100000:3.0:1788390479.446169:0:7423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000001:00080000:3.0:1788390479.446172:0:7423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788390479.446174:0:7423:0:(genops.c:885:class_export_put()) final put ffff984e85f71000/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:2.0:1788390479.446228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7919000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788390479.446286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984e87a7f000/ad5304a7-9912-4dd8-9ae2-8b8e2a127fb5 for lustre-MDT0001 00000020:00000080:2.0:1788390479.446354:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984e85f71000/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa for lustre-MDT0001 00000020:00000080:2.0:1788390479.446376:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fbaf13000 for lustre-MDT0001 00000020:00000080:2.0:1788390479.446381:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e87a78800 for lustre-MDT0001 00000020:00000080:2.0:1788390479.446383:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e876b9800 for lustre-MDT0001 00000001:00100000:0.0:1788390479.447122:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788390479.447127:0:9485:0:(genops.c:885:class_export_put()) final put ffff984fc18f8000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788390479.447149:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:0.0:1788390479.447152:0:9485:0:(genops.c:885:class_export_put()) final put ffff984e88235000/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa 00000020:00000080:1.0:1788390479.447257:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc18f8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788390479.447294:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984e88235000/5f86efe9-6df9-4a09-8c7c-860d5e3f89aa for lustre-OST0001 00000020:00000080:1.0:1788390479.447314:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc18f8800 for lustre-OST0001 00000020:00000080:1.0:1788390479.447318:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e88233800 for lustre-OST0001 00010000:00010000:3.0:1788390480.017606:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390480.210680:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788390481.041615:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390482.065545:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788390482.129859:0:15217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984e87720900 - data ffff984fb2745288/ffff984fbb1e7400 00000020:01000000:1.0:1788390482.129988:0:15217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984facc2f0c0 - data ffff984fb2586870/ffff984fb7908400 00000001:00000004:1.0:1788390482.139513:0:15217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1788390482.207668:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788390482.207682:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788390482.207706:0:15217:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff984e88b21880 x1875263098059904/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788390486 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390482.207748:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788390482.212914:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788390482.212925:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788390482.212952:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390482.212955:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788390482.213666:0:8792:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788390482.213673:0:8792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788390482.213689:0:8792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788390482.218990:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788390482.219000:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788390482.219023:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390482.219026:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788390482.219693:0:10068:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788390482.219699:0:10068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788390482.219713:0:10068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788390482.222011:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97122 00000020:00000080:0.0:1788390482.222027:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f89f62800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788390482.223402:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89f62800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788390482.228566:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97137 00000020:00000080:0.0:1788390482.228587:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f89fe0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788390482.228618:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788390482.228623:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390482.228635:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788390482.228640:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff984f89fc8000) has no exports 00000020:00000080:2.0:1788390482.228874:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89fe0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1788390482.228914:0:15217:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788390482.228930:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9756d 00000020:00000080:0.0:1788390482.228936:0:15217:0:(genops.c:885:class_export_put()) final put ffff984e877d1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788390482.229385:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788390482.229392:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390482.229404:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390482.229407:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff984fbac44d28) has no exports 00000020:00000080:0.0:1788390482.229417:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97566 00000020:00000080:0.0:1788390482.229423:0:15217:0:(genops.c:885:class_export_put()) final put ffff984fc19af800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788390482.229575:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984e877d1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788390482.230070:0:15217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788390482.230076:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788390482.230081:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1788390482.230088:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390482.230092:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788390482.230130:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc19af800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788390482.230561:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390482.230573:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788390482.230581:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9742b 00000020:00000080:0.0:1788390482.230588:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f88c43000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788390482.230619:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc19ab800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788390482.230629:0:36:0:(genops.c:885:class_export_put()) final put ffff984fc19a8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788390482.230632:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc19a8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788390482.230638:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788390482.230818:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788390482.230824:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390482.230830:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390482.230833:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff984fbaf83370) has no exports 00000020:00000080:0.0:1788390482.230838:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97424 00000020:00000080:0.0:1788390482.230842:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f88c42000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788390482.230859:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f88c43000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1788390482.231602:0:15217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788390482.231665:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788390482.231671:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788390482.231677:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390482.231692:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788390482.231758:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f88c42000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788390482.231864:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390482.231873:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788390482.231891:0:15217:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788390482.231899:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be972db 00000020:00000080:0.0:1788390482.233996:0:15217:0:(genops.c:885:class_export_put()) final put ffff984fbafdc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788390482.235779:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984f88c45000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788390482.235805:0:36:0:(genops.c:885:class_export_put()) final put ffff984f88c40800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788390482.235809:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f88c40800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788390482.235820:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788390482.237738:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788390482.237751:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390482.237765:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390482.237770:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff984fbaf84d28) has no exports 00000020:00000080:0.0:1788390482.237780:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be972d4 00000020:00000080:0.0:1788390482.237787:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f89f13800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788390482.238521:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbafdc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788390482.239304:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89f13800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788390482.241428:0:15217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788390482.241434:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788390482.241438:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788390482.241451:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788390482.241493:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984f8a4f2800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788390482.241496:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390482.241509:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390482.241515:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f89f65800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788390482.241518:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89f65800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788390482.241531:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390482.241644:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390482.241649:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390482.241652:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f89f66000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788390482.241654:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89f66000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788390482.241669:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390482.241741:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9713e 00000020:00000080:1.0:1788390482.241747:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f89fe3000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788390482.241772:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788390482.241776:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390482.241780:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788390482.241783:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff984f89fcb370) has no exports 00000020:00000080:1.0:1788390482.241800:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390482.241803:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788390482.241806:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97145 00000020:00000080:1.0:1788390482.241810:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f89fe2800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788390482.241817:0:15217:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984f988e6800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788390482.241821:0:15217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984f988e6800 3 00000020:01000004:1.0:1788390482.241824:0:15217:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff984f988e6800 from lustre-MDT0000 00000020:00000080:1.0:1788390482.241846:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390482.241851:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788390482.241853:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f89f63000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788390482.241856:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89f63000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788390482.241867:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788390482.241912:0:15217:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788390482.241916:0:15217:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788390482.241920:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788390482.241923:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390482.241926:0:15217:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788390482.241933:0:15217:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff984f89932000 13bece9d-37f8-46e7-9f27-a320529bc20d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788390482.241939:0:15217:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff984f88c4b370) has exports, disconnecting them 00000020:00080000:1.0:1788390482.241944:0:15217:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff984f89932000), last request at 1788390290 00000020:00000080:1.0:1788390482.241960:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be970e3 00000020:00010000:1.0:1788390482.241965:0:15217:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984f89932000: total 2 00000100:00080000:1.0:1788390482.241970:0:15217:0:(import.c:65:import_set_state_nolock()) ffff984f87943800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788390482.241995:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984f89932000): rc 0 00000020:00080000:1.0:1788390482.242006:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff984f88c4b370) has no exports 00000020:00000080:2.0:1788390482.242012:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89fe3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788390482.242019:0:36:0:(genops.c:885:class_export_put()) final put ffff984f89f66800/lustre-MDD0000_UUID 00000020:00010000:3.0:1788390482.242022:0:6480:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984f89932000: total 2 00000020:00000080:2.0:1788390482.242022:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89f66800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788390482.242031:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:3.0:1788390482.242091:0:6480:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984f89932000, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1788390482.242109:0:6486:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff984f9c81ac00:6486] 1 exiting: rc = 0 00000020:00000080:2.0:1788390482.242121:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89fe2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788390482.242186:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d5800/0xe156d0713be9761c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97615 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242204:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d4600/0xe156d0713be9762a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97623 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390482.242213:0:6487:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff984f9c81b200:6487] 2 exiting: rc = 0 00010000:00010000:3.0:1788390482.242218:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80031200/0xe156d0713be971df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be971d8 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242239:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f8a5cee00/0xe156d0713be971ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be971e6 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242268:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80030a00/0xe156d0713be975f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be975eb expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242280:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80031e00/0xe156d0713be97504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be974fd expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242292:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a81600/0xe156d0713be9786f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97868 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242308:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf63ce00/0xe156d0713be97654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be9764d expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242598:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f80030200/0xe156d0713be975e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be975dd expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242615:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a80000/0xe156d0713be9788b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97884 expref: 5 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242625:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d4a00/0xe156d0713be97600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be975f9 expref: 4 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242634:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d5c00/0xe156d0713be9787d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97876 expref: 3 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242645:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d5400/0xe156d0713be9760e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe156d0713be97607 expref: 2 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390482.242655:0:6480:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984f89932000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788390482.242670:0:6480:0:(genops.c:885:class_export_put()) final put ffff984f89932000/13bece9d-37f8-46e7-9f27-a320529bc20d 00010000:00010000:3.0:1788390482.242684:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390482.242692:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390482.242694:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390482.242743:0:6484:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff984f9ca40200:6484] 0 exiting: rc = 1 00000020:00000080:2.0:1788390482.242779:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89932000/13bece9d-37f8-46e7-9f27-a320529bc20d for MGS 00000020:00000080:2.0:1788390482.242819:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984f87943800 for MGS 00000100:00100000:1.0:1788390482.243003:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243008:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243012:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243017:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243021:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243025:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243029:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243033:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243037:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243045:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243050:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243053:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243058:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243062:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243066:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243070:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243075:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243080:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243087:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243092:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243097:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243102:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243106:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243110:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243115:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243120:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243125:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243130:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243135:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243143:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243152:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243165:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243169:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243180:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243187:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243192:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243197:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243202:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243210:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243215:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243220:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243225:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243229:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243234:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243239:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243244:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243248:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243254:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243260:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243264:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243269:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243274:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243279:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243284:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243289:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243294:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243305:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243310:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243315:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243339:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243347:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243353:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243358:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390482.243363:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788390482.244650:0:15217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984e87a277e0 - data ffff984e81cfc000/ffff984e877c4c00 00000020:01000000:1.0:1788390482.245083:0:15217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984f87e3c900 - data ffff984fb243eca8/ffff984f87ebdc00 00000020:00000080:1.0:1788390482.245956:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be970c7 00000020:00000080:1.0:1788390482.245965:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f85b1b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788390482.245980:0:15217:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984f988e6800 from MGS, refs=2 00000020:01000004:1.0:1788390482.245984:0:15217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984f988e6800 2 00000020:01000004:1.0:1788390482.245986:0:15217:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff984f988e6800 from MGS 00000020:00000080:1.0:1788390482.246006:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390482.246012:0:15217:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788390482.246015:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f87ded000/MGS 00000020:00000080:1.0:1788390482.246017:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff984f87ded000/MGS for MGS 00000020:01000000:1.0:1788390482.246022:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1788390482.246066:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984f85b1b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788390482.246087:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788390482.246091:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390482.246096:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788390482.246103:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff984f863f9800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788390482.246109:0:15217:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff984f89fccd28) has exports, disconnecting them 00000020:00080000:1.0:1788390482.246113:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff984f863f9800), last request at 1788390290 00000020:00000080:1.0:1788390482.246117:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97192 00000020:00080000:1.0:1788390482.246126:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984f863f9800): rc 0 00000020:00000080:1.0:1788390482.246130:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f863f9800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788390482.246865:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984f863f9800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788390482.248541:0:15217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788390482.248548:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390482.248553:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788390482.248563:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788390482.248603:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984f894ec800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788390482.248753:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390482.248761:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788390482.248766:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f89fe1800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788390482.248769:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89fe1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788390482.248779:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788390482.248863:0:15217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984f988e6800 1 00000020:00000080:0.0:1788390482.248870:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be970b9 00000020:00000080:0.0:1788390482.248880:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f87dea000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788390482.248898:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788390482.248902:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390482.248906:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788390482.248909:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff984f88c499b8) has no exports 00000020:00000080:2.0:1788390482.249048:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984f87dea000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788390482.274059:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390482.274072:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788390482.274078:0:15217:0:(genops.c:885:class_export_put()) final put ffff984f988e7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788390482.274082:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff984f988e7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788390482.274099:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788390482.274311:0:15217:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff984f988e0000 00000020:02000400:0.0:1788390482.274384:0:15217:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788390483.089590:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390483.537675:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390483.537700:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098062208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390483.537782:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390483.537856:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098062208 00000100:00100000:0.0:1788390483.537863:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098062208 00000100:00100000:0.0:1788390483.537921:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788390483.537931:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098062208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788390483.537961:0:8410:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788390483.538006:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098062208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390483.538014:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788390483.538036:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390483.538069:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098062208:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788390484.049502:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788390484.049508:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788390484.049512:0:36:0:(import.c:65:import_set_state_nolock()) ffff984fbac02800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390484.049519:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 299 00000100:00080000:3.0:1788390484.049525:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788390484.049532:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff984fbac02800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390484.049554:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adea00 x1875263098062464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390484.049570:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788390484.049573:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788390484.049575:0:36:0:(import.c:65:import_set_state_nolock()) ffff984fb791b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390484.049579:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 299 00000100:00080000:3.0:1788390484.049581:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788390484.049584:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff984fb791b000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390484.049591:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098062336:0@lo:400:kworker.0 00000100:00100000:3.0:1788390484.049594:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88aded80 x1875263098062592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390484.049602:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788390484.049605:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788390484.049606:0:36:0:(import.c:65:import_set_state_nolock()) ffff984e85f76000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390484.049609:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 299 00000100:00080000:3.0:1788390484.049611:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788390484.049613:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff984e85f76000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390484.049628:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adfb80 x1875263098062720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1788390484.049640:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263098062336 offset 0 length 224: 4 00000100:00080000:3.0:1788390484.049649:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788390484.049652:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788390484.049653:0:36:0:(import.c:65:import_set_state_nolock()) ffff984e876bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390484.049656:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 299 00000100:00080000:3.0:1788390484.049658:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788390484.049661:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff984e876bc000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390484.049704:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098062464:0@lo:38:kworker.0 00000100:00100000:2.0:1788390484.049754:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390484.049774:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875263098062592:0@lo:38:kworker.0 00000100:00100000:0.0:1788390484.049774:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390484.049783:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098062848:0@lo:400:kworker.0 00000100:00100000:2.0:1788390484.049795:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390484.049810:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390484.049811:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1875263098062720:0@lo:38:kworker.0 00000100:00100000:2.0:1788390484.049829:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390484.049850:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098062592 00000100:00100000:2.0:1788390484.049854:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098062464 00000100:00100000:2.0:1788390484.049858:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098062464 00000100:00100000:0.0:1788390484.049858:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098062592 00000100:00100000:0.0:1788390484.049883:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098062848 00000100:00100000:2.0:1788390484.049886:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788390484.049886:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098062848 00000100:00100000:2.0:1788390484.049892:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1875263098062464:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788390484.049911:0:6497:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788390484.049915:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098062720 00000100:00100000:0.0:1788390484.049917:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098062720 00000100:00100000:0.0:1788390484.049925:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788390484.049931:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098062848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390484.049949:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1875263098062464:12345-0@lo:38:kworker.0 Request processed in 55us (196us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788390484.049956:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788390484.049967:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098062848:12345-0@lo:400:kworker.0 Request processed in 37us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390484.049976:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788390484.049981:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875263098062592:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788390484.049990:0:6492:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788390484.050003:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adca80 x1875263098062976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390484.050018:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875263098062592:12345-0@lo:38:kworker.0 Request processed in 37us (223us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788390484.050040:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098063232:0@lo:400:kworker.0 00000100:00100000:3.0:1788390484.050070:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390484.050094:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390484.050101:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098063104:0@lo:400:kworker.0 00000100:00100000:3.0:1788390484.050121:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390484.050138:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098063104 00000100:00100000:3.0:1788390484.050142:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098063104 00000100:00100000:0.0:1788390484.052146:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788390484.052188:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788390484.052195:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1875263098062720:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788390484.052228:0:8996:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788390484.052294:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1875263098062720:12345-0@lo:38:kworker.0 Request processed in 98us (2463us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390484.052301:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:0.0:1788390484.052348:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788390484.052410:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff984e88addf80 x1875263098062848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390484.052425:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098062848:0@lo:400:kworker.0 00000100:00100000:0.0:1788390484.054233:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263098062976:0@lo:38:kworker.0 00000100:00100000:0.0:1788390484.054315:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390484.054387:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fbac02800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390484.054392:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788390484.054396:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098062464:0@lo:38:kworker.0 00000100:00080000:0.0:1788390484.054410:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fb791b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390484.054414:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788390484.054417:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875263098062592:0@lo:38:kworker.0 00000100:00080000:0.0:1788390484.054427:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e85f76000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390484.054430:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788390484.054433:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1875263098062720:0@lo:38:kworker.0 00000100:00100000:0.0:1788390484.054470:0:8996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098062976 00000100:00100000:0.0:1788390484.054483:0:8996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098062976 00000100:00100000:0.0:1788390484.054518:0:8996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788390484.054525:0:8996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1875263098062976:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788390484.054542:0:8996:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788390484.054585:0:8996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1875263098062976:12345-0@lo:38:kworker.0 Request processed in 58us (270us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390484.054592:0:8996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:0.0:1788390484.054622:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e876bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390484.054625:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788390484.054628:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263098062976:0@lo:38:kworker.0 00000100:00100000:2.0:1788390484.054684:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788390484.054776:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098063232 00000100:00100000:2.0:1788390484.054780:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098063232 00000100:00100000:2.0:1788390484.054823:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788390484.054831:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098063232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390484.054872:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098063232:12345-0@lo:400:kworker.0 Request processed in 43us (4801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390484.054879:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788390484.054894:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390484.054925:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098063232:0@lo:400:kworker.0 00000100:00100000:2.0:1788390484.054935:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390484.054940:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098063360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390484.054966:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390484.054994:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098063360 00000100:00100000:2.0:1788390484.054998:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098063360 00000100:00100000:2.0:1788390484.055022:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788390484.055029:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098063360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788390484.055048:0:8411:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788390484.055081:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098063360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390484.055087:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788390484.055116:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098063360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788390484.057154:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788390484.057170:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098063104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390484.057264:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098063104:12345-0@lo:400:kworker.0 Request processed in 100us (7142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390484.057271:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:3.0:1788390484.057313:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff984e88adce00 x1875263098063104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390484.057345:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098063104:0@lo:400:kworker.0 00010000:00010000:1.0:1788390484.114308:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788390484.699211:0:15420:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788390484.713679:0:15420:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788390484.713746:0:15420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.713762:0:15420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.713771:0:15420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.713779:0:15420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.713804:0:15420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788390484.713809:0:15420:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788390484.713836:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390484.713840:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788390484.713846:0:15420:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788390484.713865:0:15420:0:(import.c:65:import_set_state_nolock()) ffff984fb791b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788390484.713870:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390484.713872:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788390484.713875:0:15420:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788390484.714743:0:15420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714755:0:15420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714762:0:15420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714768:0:15420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714782:0:15420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788390484.714787:0:15420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714794:0:15420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714800:0:15420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714807:0:15420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714818:0:15420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788390484.714831:0:15420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714838:0:15420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714844:0:15420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714850:0:15420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714866:0:15420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788390484.714870:0:15420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714876:0:15420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714882:0:15420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714888:0:15420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.714896:0:15420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:0.0:1788390484.714899:0:15420:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788390484.714924:0:15420:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788390484.714929:0:15420:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788390484.714933:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390484.714938:0:15420:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788390484.714950:0:15420:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff984e877d2000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390484.714956:0:15420:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff984e85f3d000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390484.714961:0:15420:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff984f85ae99b8) has exports, disconnecting them 00000020:00080000:0.0:1788390484.714965:0:15420:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff984e877d2000), last request at 1788390484 00000020:00000080:0.0:1788390484.714971:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be974c5 00000100:00080000:0.0:1788390484.714988:0:15420:0:(import.c:65:import_set_state_nolock()) ffff984e877d5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788390484.715033:0:15420:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984e877d2000): rc 0 00000020:00000080:0.0:1788390484.715036:0:15420:0:(genops.c:885:class_export_put()) final put ffff984e877d2000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788390484.715055:0:15420:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff984e85f3d000), last request at 1788390484 00000020:00000080:0.0:1788390484.715058:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9739f 00000100:00080000:0.0:1788390484.715063:0:15420:0:(import.c:65:import_set_state_nolock()) ffff984e85f3a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788390484.715069:0:15420:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984e85f3d000): rc 0 00000020:00000080:0.0:1788390484.715071:0:15420:0:(genops.c:885:class_export_put()) final put ffff984e85f3d000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788390484.715079:0:15420:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb4a7c1c8bae0 00000100:00080000:0.0:1788390484.715095:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390484.715102:0:15420:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff984e88adf100 x1875263098060288/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788390492 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390484.715117:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1788390484.715920:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098060288:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788390484.715959:0:15420:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788390484.715962:0:15420:0:(import.c:65:import_set_state_nolock()) ffff984fbac02800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788390484.716090:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788390484.716094:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:0.0:1788390484.716111:0:15420:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788390484.716169:0:15420:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788390484.716190:0:15420:0:(import.c:65:import_set_state_nolock()) ffff984f89f61800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788390484.716203:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788390484.716213:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:0.0:1788390484.716222:0:15420:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390484.716288:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098063488:0@lo:9:umount.0 00000100:00100000:0.0:1788390484.716373:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390484.716425:0:15420:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788390484.716435:0:15420:0:(import.c:65:import_set_state_nolock()) ffff984f89f62000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788390484.716449:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098063616:0@lo:9:umount.0 00000100:00100000:0.0:1788390484.716470:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788390484.716507:0:15420:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff984f85ae99b8) has no exports 00010000:00010000:0.0:1788390484.716538:0:13156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788390484.716545:0:13156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.716554:0:13156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390484.716558:0:13156:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.716567:0:13156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390484.716575:0:13156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390484.716580:0:13156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390484.716583:0:13156:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788390484.716585:0:13156:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788390484.716611:0:13156:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.716618:0:13156:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390484.716638:0:13156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.716645:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4000/0xe156d0713be97615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9761c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.716655:0:13156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788390484.716659:0:13156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.716664:0:13156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80031c00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390484.716667:0:13156:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.716673:0:13156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390484.716678:0:13156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390484.716683:0:13156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390484.716685:0:13156:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1788390484.716687:0:13156:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1788390484.716699:0:13156:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716778:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788390484.716785:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716792:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5ce400 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390484.716795:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716802:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390484.716807:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390484.716812:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788390484.716814:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788390484.716816:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788390484.716830:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716837:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390484.716843:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716848:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f8a5ce400/0xe156d0713be974fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be97504 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716861:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390484.716864:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716880:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5600 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390484.716883:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716889:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390484.716895:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390484.716901:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788390484.716903:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788390484.716905:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788390484.716919:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716925:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390484.716944:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716951:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5600/0xe156d0713be97884 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9788b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716961:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390484.716964:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716970:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f8a5cf200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390484.716973:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.716986:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390484.716992:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390484.716996:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788390484.716999:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788390484.717000:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788390484.717013:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.717019:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390484.717024:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.717030:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f8a5cf200/0xe156d0713be971e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be971ed expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390484.717043:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390484.717044:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390484.717046:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390484.717054:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390484.717060:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390484.717073:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098063488 00000100:00100000:3.0:1788390484.717080:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098063488 00000100:00100000:3.0:1788390484.717123:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098063616 00000100:00100000:3.0:1788390484.717126:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098063616 00000100:00100000:3.0:1788390484.717147:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788390484.717157:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875263098063488:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788390484.717187:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be973ec 00000100:00080000:3.0:1788390484.717194:0:8409:0:(import.c:65:import_set_state_nolock()) ffff984fbb3ba000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390484.717234:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788390484.717446:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3621:x1875263098063488:12345-0@lo:9:umount.0 Request processed in 289us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390484.717454:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788390484.717470:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788390484.717476:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875263098063616:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788390484.717488:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9752e 00000100:00080000:3.0:1788390484.717494:0:8409:0:(import.c:65:import_set_state_nolock()) ffff984fc18fc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390484.717514:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788390484.717596:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3621:x1875263098063616:12345-0@lo:9:umount.0 Request processed in 119us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390484.717603:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788390484.717696:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098063744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390484.717741:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390484.717773:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390484.717779:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098064000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390484.717800:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390484.717830:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098064256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390484.717849:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390484.717864:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390484.717870:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098064128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390484.717889:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390484.717908:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788390484.717933:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f89f62000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788390484.717946:0:3621:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788390484.717947:0:3621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390484.717951:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098063616:0@lo:9:umount.0 00000100:00080000:3.0:1788390484.717966:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f89f61800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788390484.717969:0:3621:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788390484.717971:0:3621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390484.717973:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098063488:0@lo:9:umount.0 00010000:00010000:3.0:1788390484.717990:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390484.718031:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984e877d2000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788390484.718075:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984e85f3d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788390484.718100:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e877d5000 for lustre-MDT0001 00000020:00000080:3.0:1788390484.718107:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e85f3a000 for lustre-MDT0001 00000100:00100000:3.0:1788390484.718132:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098063744 00000100:00100000:3.0:1788390484.718136:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098063744 00000100:00100000:3.0:1788390484.718154:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098064000 00000100:00100000:3.0:1788390484.718157:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098064000 00000100:00100000:3.0:1788390484.718164:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098064256 00000100:00100000:3.0:1788390484.718166:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098064256 00000100:00100000:3.0:1788390484.718173:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098064128 00000100:00100000:3.0:1788390484.718175:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098064128 00000100:00100000:3.0:1788390484.718186:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788390484.718192:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3622:x1875263098063744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788390484.718199:0:6479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390484 with bad export cookie 16237394691285938403 00010000:00010000:0.0:1788390484.719781:0:13156:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390484.719814:0:13156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.719824:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f80031c00/0xe156d0713be97623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe156d0713be9762a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390484.719861:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390484.719863:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390484.719865:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390484.719881:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390484.719900:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263098063872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390484.719968:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390484.720256:0:10369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098063872 00000100:00100000:0.0:1788390484.720264:0:10369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098063872 00000100:00100000:0.0:1788390484.720295:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390484.720301:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3622:x1875263098064000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788390484.720307:0:10369:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390484 with bad export cookie 16237394691285938403 00000100:00100000:0.0:1788390484.720362:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3622:x1875263098064000:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (2561us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788390484.720369:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390484.720380:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788390484.720385:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3625:x1875263098064256:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788390484.720388:0:10369:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390484 with bad export cookie 16237394691285938403 00000100:00100000:0.0:1788390484.720412:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3625:x1875263098064256:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (2562us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788390484.720417:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788390484.720426:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788390484.720430:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3625:x1875263098064128:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788390484.720433:0:10369:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390484 with bad export cookie 16237394691285938403 00000100:00100000:0.0:1788390484.720450:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3625:x1875263098064128:12345-0@lo:103:ldlm_bl.0 Request processed in 20us (2562us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788390484.720464:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788390484.720474:0:10369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788390484.720477:0:10369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875263098063872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788390484.720481:0:10369:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390484 with bad export cookie 16237394691285938403 00000100:00100000:0.0:1788390484.720502:0:10369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875263098063872:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (536us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788390484.720507:0:10369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788390484.720536:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788390484.720539:0:3623:0:(import.c:65:import_set_state_nolock()) ffff984f862ae800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788390484.720543:0:3623:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788390484.722535:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788390484.724748:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3622:x1875263098063744:12345-0@lo:103:ldlm_bl.0 Request processed in 6547us (6999us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788390484.724763:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788390484.724841:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788390484.734234:0:3623:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.111@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788390484.734240:0:3623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788390484.734251:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e88add500 x1875263098062336/t0(0) o400->MGC192.168.202.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788390500 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390484.734265:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e88b23480 x1875263098063744/t0(0) o103->MGC192.168.202.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390500 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390484.734275:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e88adce00 x1875263098064000/t0(0) o103->MGC192.168.202.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390500 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390484.734282:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e88adc000 x1875263098064256/t0(0) o103->MGC192.168.202.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390500 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390484.734290:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e88adf100 x1875263098064128/t0(0) o103->MGC192.168.202.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390500 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390484.734297:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e88b22a00 x1875263098063872/t0(0) o103->MGC192.168.202.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390500 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788390484.734306:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788390484.734309:0:3623:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788390484.734354:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788390484.734736:0:3622:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff984f862ae800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788390484.734759:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098063744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390484.734787:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bece9d-37f8-46e7-9f27-a320529bc20d:3622:1875263098064000:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788390484.735017:0:3625:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff984f862ae800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788390484.735470:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098064256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390484.735493:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098062336:0@lo:400:kworker.0 00000100:00100000:3.0:1788390484.735514:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13bece9d-37f8-46e7-9f27-a320529bc20d:3625:1875263098064128:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788390484.735572:0:3623:0:(import.c:65:import_set_state_nolock()) ffff984f862ae800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390484.735578:0:3623:0:(import.c:510:import_select_connection()) MGC192.168.202.111@tcp: connect to NID 0@lo last attempt 111 00000100:00080000:0.0:1788390484.735586:0:3623:0:(import.c:624:import_select_connection()) MGC192.168.202.111@tcp: import ffff984f862ae800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390484.735742:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e86bd7100 x1875263098064384/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390484.735799:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13bece9d-37f8-46e7-9f27-a320529bc20d:3621:1875263098064384:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1788390484.735858:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263098064384 offset 0 length 520: 4 00000100:00100000:1.0:1788390484.735953:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bece9d-37f8-46e7-9f27-a320529bc20d:3623:1875263098063872:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788390484.751737:0:15420:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff984f85ae99b8) has no exports 00000020:01000000:1.0:1788390484.788627:0:15420:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984e87720f00 - data ffff984e81ca3948/ffff984fbb1e4000 00000020:01000000:1.0:1788390484.788890:0:15420:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984fbacf4de0 - data ffff984fb2410ca8/ffff984fbad77000 00000001:00000004:0.0:1788390484.800546:0:15420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788390484.845478:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390484.845487:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788390484.845495:0:15420:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788390484.848634:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788390484.848641:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:0.0:1788390484.848662:0:15420:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390484.848665:0:15420:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788390484.850732:0:8786:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788390484.850739:0:8786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1788390484.850751:0:8786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788390484.851777:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788390484.851782:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:0.0:1788390484.851799:0:15420:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390484.851802:0:15420:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788390484.852379:0:10064:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788390484.852383:0:10064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1788390484.852393:0:10064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788390484.853713:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97209 00000020:00000080:0.0:1788390484.853724:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb7b75000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788390484.854059:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7b75000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788390484.857234:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9721e 00000020:00000080:0.0:1788390484.857247:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb7b70800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788390484.857257:0:15420:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788390484.857261:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390484.857270:0:15420:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788390484.857274:0:15420:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff984f85ae8000) has no exports 00000020:00000080:3.0:1788390484.857413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7b70800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:0.0:1788390484.857600:0:15420:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788390484.857610:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97527 00000020:00000080:0.0:1788390484.857615:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fbb3bc000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788390484.857631:0:15420:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788390484.857635:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390484.857642:0:15420:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390484.857645:0:15420:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff984fbac43370) has no exports 00000020:00000080:0.0:1788390484.857650:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97520 00000020:00000080:0.0:1788390484.857661:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fbb3bf000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788390484.858021:0:15420:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788390484.858025:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788390484.858030:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:0.0:1788390484.858036:0:15420:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390484.858039:0:15420:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390484.858066:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390484.858073:0:15420:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788390484.858079:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be973e5 00000020:00000080:0.0:1788390484.858084:0:15420:0:(genops.c:885:class_export_put()) final put ffff984e85f73000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788390484.858087:0:15420:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788390484.858091:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390484.858094:0:15420:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390484.858096:0:15420:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff984fbaf819b8) has no exports 00000020:00000080:0.0:1788390484.858099:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be973de 00000020:00000080:0.0:1788390484.858102:0:15420:0:(genops.c:885:class_export_put()) final put ffff984f89f64800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788390484.858476:0:15420:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788390484.858479:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788390484.858481:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:0.0:1788390484.858485:0:15420:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390484.858486:0:15420:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390484.858509:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390484.858514:0:15420:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788390484.858522:0:15420:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788390484.858526:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97241 00000020:00000080:0.0:1788390484.858531:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fbad79800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788390484.858535:0:15420:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788390484.858538:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390484.858541:0:15420:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390484.858544:0:15420:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff984fbac419b8) has no exports 00000020:00000080:0.0:1788390484.858548:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9723a 00000020:00000080:0.0:1788390484.858550:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fbac03000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788390484.859306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbb3bc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788390484.859316:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbb3bf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788390484.859334:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984f89f62000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788390484.859340:0:36:0:(genops.c:885:class_export_put()) final put ffff984fbb061800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788390484.859342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbb061800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788390484.859346:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788390484.859422:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984e85f73000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788390484.859428:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984f89f64800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788390484.859432:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984f89f61800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788390484.859437:0:36:0:(genops.c:885:class_export_put()) final put ffff984e85f74800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788390484.859439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984e85f74800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788390484.859441:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788390484.859465:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbad79800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788390484.859469:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbac03000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788390484.859626:0:15420:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788390484.859629:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788390484.859632:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788390484.859637:0:15420:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788390484.859675:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390484.859681:0:15420:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788390484.859718:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390484.859723:0:15420:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788390484.859726:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb78a6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788390484.859729:0:15420:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb78a6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788390484.859733:0:15420:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788390484.859874:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97225 00000020:00000080:2.0:1788390484.859880:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb7b75800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788390484.859884:0:15420:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788390484.859888:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788390484.859892:0:15420:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788390484.859895:0:15420:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff984fb7b83370) has no exports 00000020:00000080:2.0:1788390484.859912:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390484.859915:0:15420:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788390484.859919:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9722c 00000020:00000080:2.0:1788390484.859922:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb7b70000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788390484.859928:0:15420:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fb76a1000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788390484.859931:0:15420:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fb76a1000 2 00000020:01000004:2.0:1788390484.859934:0:15420:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff984fb76a1000 from lustre-MDT0001 00000020:00000080:2.0:1788390484.859951:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390484.859954:0:15420:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788390484.859958:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb7b72000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788390484.859969:0:15420:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7b72000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788390484.859975:0:15420:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788390484.860002:0:15420:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788390484.860006:0:15420:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788390484.860009:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788390484.860012:0:15420:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788390484.860018:0:15420:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff984fb791b800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788390484.860023:0:15420:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff984fbac08000) has exports, disconnecting them 00000020:00080000:2.0:1788390484.860027:0:15420:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff984fb791b800), last request at 1788390307 00000020:00000080:2.0:1788390484.860030:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97280 00000020:00080000:2.0:1788390484.860042:0:15420:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984fb791b800): rc 0 00000020:00000080:2.0:1788390484.860045:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb791b800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788390484.860714:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fbac02800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788390484.860723:0:36:0:(genops.c:885:class_export_put()) final put ffff984fbac04800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788390484.860725:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbac04800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788390484.860730:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788390484.860863:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7b75800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788390484.860868:0:36:0:(genops.c:885:class_export_put()) final put ffff984fb7b74800/lustre-MDD0001_UUID 00000020:00000080:3.0:1788390484.860870:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7b74800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788390484.860873:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788390484.861040:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7b70000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788390484.861045:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb791b800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788390484.861367:0:15420:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788390484.861372:0:15420:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390484.861376:0:15420:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788390484.861381:0:15420:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788390484.861399:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fb791b000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788390484.861542:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390484.861548:0:15420:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788390484.861552:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb7918000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788390484.861554:0:15420:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7918000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788390484.861557:0:15420:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788390484.861589:0:15420:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fb76a1000 1 00000020:00000080:3.0:1788390484.861594:0:15420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be971bc 00000020:00000080:3.0:1788390484.861599:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb791f000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788390484.861608:0:15420:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788390484.861614:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb791f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788390484.861623:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390484.861627:0:15420:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788390484.861629:0:15420:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff984f88c48000) has no exports 00000020:00000080:3.0:1788390484.942227:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390484.942242:0:15420:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788390484.942248:0:15420:0:(genops.c:885:class_export_put()) final put ffff984fb76a2000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788390484.942253:0:15420:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb76a2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788390484.942260:0:15420:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788390484.942491:0:15420:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff984fb76a0800 00000020:01000000:3.0:1788390484.942509:0:15420:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788390484.942513:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390484.942517:0:15420:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788390484.942521:0:15420:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff984f85aeb370) has no exports 00000100:00100000:3.0:1788390484.942666:0:6494:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff984f853b6800:6494] 2 exiting: rc = 0 00000100:00100000:0.0:1788390484.942683:0:8996:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff984fbae7ce00:8996] 3 exiting: rc = 0 00000100:00100000:0.0:1788390484.942825:0:12122:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff984e8793ec00:12122] 4 exiting: rc = 0 00000100:00100000:2.0:1788390484.942853:0:6492:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff984f90f63200:6492] 0 exiting: rc = 1 00000100:00100000:1.0:1788390484.943119:0:6493:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff984f90f62800:6493] 1 exiting: rc = 0 00000100:00100000:3.0:1788390484.943221:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943229:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943234:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943240:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943246:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943252:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943257:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943263:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943268:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943273:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943278:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943284:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943289:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943294:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943299:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943305:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943309:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943314:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943427:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943442:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943448:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943453:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943458:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943464:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943469:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943475:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943480:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943485:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943490:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943504:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943509:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943515:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943520:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943525:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943530:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943536:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943541:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943545:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943552:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943556:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943562:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943571:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943578:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943584:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943589:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943595:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943600:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943605:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943610:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943615:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943620:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943626:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943631:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943636:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943641:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943646:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943652:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943658:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943663:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943668:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943673:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943679:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943684:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.943694:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.949301:0:14240:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff984f8a5fa000:14240] 2 exiting: rc = 0 00000100:00100000:1.0:1788390484.949503:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff984f853b7e00:6495] 0 exiting: rc = 1 00000100:00100000:2.0:1788390484.949816:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff984f853b6a00:6496] 1 exiting: rc = 0 00000100:00100000:3.0:1788390484.950034:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950043:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950050:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950057:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950064:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950070:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950076:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950081:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950087:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950094:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950099:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950105:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950112:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950117:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950123:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950128:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950133:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950138:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950143:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950148:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950153:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950158:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950163:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950169:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950174:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950179:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950185:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950190:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950195:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950200:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950205:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950210:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950216:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950221:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950241:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950246:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950251:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950256:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950261:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950272:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950278:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950284:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950290:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950295:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950300:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950305:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950311:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950316:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950794:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950805:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950811:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950816:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950880:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950886:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950891:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950902:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950915:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950920:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950926:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950932:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950937:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950941:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950951:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.950956:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390484.956100:0:7527:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff984f83f0e400:7527] 2 exiting: rc = 0 00000100:00100000:0.0:1788390484.956100:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff984f853b7000:6497] 0 exiting: rc = 1 00000100:00100000:0.0:1788390484.956266:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff984f87823c00:6498] 1 exiting: rc = 0 00000100:00100000:2.0:1788390484.956388:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956398:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956408:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956414:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956420:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956426:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956432:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956438:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956445:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956461:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956468:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956474:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956485:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956492:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956498:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956504:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956510:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956515:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956541:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956547:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956556:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956575:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956582:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956588:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956593:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956599:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956604:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956610:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956616:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956622:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956628:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956634:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956640:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956660:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956673:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956678:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956684:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956691:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956698:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956713:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956719:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956725:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956731:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956745:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956754:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956778:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956784:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956794:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956801:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956807:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956812:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956819:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956825:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956839:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956854:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956860:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956865:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956887:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956895:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956902:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956917:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956924:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956930:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.956938:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390484.964588:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff984f87822600:6499] 0 exiting: rc = 1 00000100:00100000:1.0:1788390484.966253:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff984f87822000:6500] 1 exiting: rc = 0 00000100:00100000:0.0:1788390484.971471:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971482:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971488:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971493:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971498:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971506:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971514:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971521:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971530:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971538:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971543:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971548:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971565:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971571:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971576:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971591:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971597:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971603:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971609:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971614:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971619:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971624:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971630:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971635:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971640:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971645:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971649:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971654:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971658:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971663:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971682:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971687:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971691:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971695:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971710:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971717:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971721:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971726:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971732:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971737:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971746:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971751:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971756:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971761:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971766:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971771:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971776:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971780:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971785:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971790:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971794:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971798:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971803:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971808:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971812:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971817:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971821:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971826:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971831:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971836:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971841:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971845:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971851:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.971857:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390484.972564:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff984f87823a00:6501] 0 exiting: rc = 1 00000100:00100000:2.0:1788390484.972715:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff984f87822400:6502] 1 exiting: rc = 0 00000100:00100000:0.0:1788390484.972828:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972842:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972848:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972853:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972858:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972863:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972869:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972874:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972879:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972885:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972891:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972896:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972902:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972907:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972912:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972917:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972922:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972927:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972933:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972939:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972944:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972948:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972952:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972957:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972962:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972966:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972971:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972976:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972982:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972987:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972992:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.972996:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973001:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973006:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973011:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973016:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973028:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973034:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973039:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973044:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973048:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973054:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973059:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973064:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973069:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973072:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973076:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973079:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973082:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973086:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973089:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973092:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973095:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973098:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973101:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973105:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973110:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973115:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973119:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973124:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973128:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973133:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973139:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973144:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390484.973558:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff984f83f0e200:6503] 0 exiting: rc = 1 00000100:00100000:1.0:1788390484.973637:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff984f83f0f600:6504] 1 exiting: rc = 0 00000100:00100000:0.0:1788390484.973678:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973683:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973687:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973690:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973693:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973697:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973713:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973726:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973731:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973736:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973741:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973745:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973749:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973754:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973760:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973765:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973769:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973775:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973780:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973785:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973790:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973796:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973801:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973807:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973812:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973818:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973823:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973828:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973833:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973838:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973843:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973848:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973853:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973858:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973863:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973869:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973875:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973880:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973885:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973890:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973894:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973899:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973912:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973918:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973924:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973929:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973934:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973939:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973944:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973949:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973953:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973958:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973963:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973969:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973974:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973980:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973985:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973990:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.973994:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.974000:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.974004:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.974010:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.974015:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390484.974020:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.975204:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff984f83f0f000:6505] 0 exiting: rc = 1 00000100:00100000:1.0:1788390484.975214:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff984f83f0e600:6506] 1 exiting: rc = 0 00000100:00100000:3.0:1788390484.975994:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff984f83f0e000:6507] 2 exiting: rc = 0 00000100:00100000:2.0:1788390484.976366:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976376:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976385:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976394:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976416:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976423:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976428:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976433:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976439:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976445:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976450:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976455:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976460:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976466:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976471:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976477:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976483:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976488:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976493:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976498:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976503:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976521:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976540:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976546:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976565:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976572:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976586:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976593:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976599:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976604:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976610:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976616:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976623:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976628:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976634:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976640:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976646:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976652:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976657:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976664:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976670:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976676:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976682:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976688:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976694:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976730:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976738:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976744:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976750:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976756:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976762:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976768:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976775:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976781:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976787:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976792:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976799:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976813:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976819:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976825:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976831:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976837:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976843:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390484.976849:0:15420:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788390484.980891:0:15420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788390484.980906:0:15420:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788390484.980911:0:15420:0:(genops.c:885:class_export_put()) final put ffff984f894e9000/MDS_uuid 00000020:00000080:2.0:1788390484.980917:0:15420:0:(genops.c:844:class_export_destroy()) destroying export ffff984f894e9000/MDS_uuid for MDS 00000020:01000000:2.0:1788390484.980922:0:15420:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788390484.981080:0:15420:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788390485.137528:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390486.165063:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390487.185573:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788390487.482909:0:15620:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788390487.493463:0:15620:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788390487.493522:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390487.493534:0:15620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390487.493538:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390487.493544:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390487.493573:0:15620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788390487.493578:0:15620:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788390487.493604:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788390487.493608:0:15620:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788390487.493614:0:15620:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788390487.493620:0:15620:0:(import.c:65:import_set_state_nolock()) ffff984e85f76000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788390487.493633:0:13156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1788390487.493641:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788390487.493643:0:13156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390487.493646:0:15620:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788390487.493652:0:15620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788390487.493656:0:13156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f80030c00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390487.493662:0:13156:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390487.493672:0:13156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390487.493701:0:13156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390487.493708:0:13156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390487.493710:0:13156:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788390487.493713:0:13156:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788390487.493729:0:13156:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984f862ae800 00010000:00010000:0.0:1788390487.493733:0:13156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390487.493739:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f80030c00/0xe156d0713be975f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be97600 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390487.493751:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390487.493753:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390487.493755:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788390487.494475:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788390487.494479:0:15620:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788390487.494483:0:15620:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788390487.494501:0:15620:0:(import.c:65:import_set_state_nolock()) ffff984e85f3c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788390487.494588:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1875263098064512:0@lo:39:umount.0 00000400:00000100:3.0:1788390487.494643:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263098064512 offset 0 length 224: 4 00010000:00010000:0.0:1788390488.209525:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788390489.169503:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788390489.169514:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788390489.169519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788390489.169523:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788390489.169527:0:37:0:(import.c:65:import_set_state_nolock()) ffff984e876bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390489.169536:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 304 00000100:00080000:2.0:1788390489.169543:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788390489.169553:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff984e876bc000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390489.169595:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e883ad180 x1875263098064640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390489.169724:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263098064768:0@lo:400:kworker.0 00000400:00000100:1.0:1788390489.169777:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263098064768 offset 0 length 224: 4 00000100:00100000:3.0:1788390489.170166:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263098064640:0@lo:38:kworker.0 00000400:00000100:3.0:1788390489.170193:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263098064640 offset 0 length 520: 4 00010000:00010000:0.0:1788390489.233522:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788390490.193460:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788390490.193471:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788390490.193474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788390490.193477:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788390490.193589:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000001:00100000:2.0:1788390490.195536:0:9485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788390490.195544:0:9485:0:(genops.c:885:class_export_put()) final put ffff984fc18fb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788390490.195621:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc18fb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000100:00100000:0.0:1788390490.195674:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098064896:0@lo:400:kworker.0 00000020:00000080:3.0:1788390490.195720:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fc18fc000 for lustre-OST0001 00000400:00000100:0.0:1788390490.195827:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263098064896 offset 0 length 224: 4 00000001:00100000:1.0:1788390490.196224:0:8402:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788390490.196228:0:8402:0:(genops.c:885:class_export_put()) final put ffff984fbb3bb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788390490.196264:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbb3bb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788390490.196288:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984fbb3ba000 for lustre-OST0000 00010000:00010000:0.0:1788390490.257536:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390491.282203:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390492.306650:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390493.329573:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788390494.228278:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788390494.228289:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788390494.228292:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788390494.228296:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788390494.228435:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098065024:0@lo:400:kworker.0 00000400:00000100:0.0:1788390494.228490:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263098065024 offset 0 length 224: 4 00000100:00100000:1.0:1788390494.289464:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390484/real 1788390484] req@ffff984e86bd7100 x1875263098064384/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788390494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390494.289500:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e86bd7100 x1875263098064384/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788390494 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788390494.289521:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f862ae800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390494.289549:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788390494.289553:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13bece9d-37f8-46e7-9f27-a320529bc20d:3621:1875263098064384:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1788390494.290018:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788390494.290024:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788390494.290026:0:37:0:(import.c:65:import_set_state_nolock()) ffff984f862ae800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390494.290031:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.111@tcp: connect to NID 0@lo last attempt 305 00000100:00080000:3.0:1788390494.290036:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788390494.290042:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.111@tcp: import ffff984f862ae800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390494.290076:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adf100 x1875263098065152/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390494.290101:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788390494.290105:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788390494.290261:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13bece9d-37f8-46e7-9f27-a320529bc20d:3621:1875263098065152:0@lo:250:kworker.0 00000400:00000100:1.0:1788390494.290314:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263098065152 offset 0 length 520: 4 00010000:00010000:0.0:1788390494.354311:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390495.377591:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390496.402551:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390497.361626:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390487/real 1788390487] req@ffff984e883afb80 x1875263098064512/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788390497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390497.361673:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e883afb80 x1875263098064512/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788390497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788390497.361710:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e85f3c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788390497.361735:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1875263098064512:0@lo:39:umount.0 00000100:00080000:0.0:1788390497.363261:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788390497.363268:0:15620:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788390497.363275:0:15620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788390497.365003:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390497.365022:0:15620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390497.365030:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390497.365038:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390497.365126:0:15620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390497.365134:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390497.365141:0:15620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390497.365148:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390497.365154:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390497.368545:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390497.368559:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390497.368597:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5e00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390497.368601:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390497.368611:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390497.368618:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390497.368624:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788390497.368627:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788390497.368643:0:6480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984f862ae800 00010000:00010000:1.0:1788390497.368647:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390497.368654:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5e00/0xe156d0713be97607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be9760e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390497.368673:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390497.368676:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390497.368682:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390497.368685:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390497.368691:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390497.368704:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390497.368709:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788390497.368711:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788390497.368714:0:6480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984f862ae800 00010000:00010000:1.0:1788390497.368717:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390497.368723:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390497.368724:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390497.368726:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390497.368816:0:15620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390497.368828:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e86a80200/0xe156d0713be97876 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be9787d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390497.368839:0:15620:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788390497.368844:0:15620:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788390497.368846:0:15620:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788390497.368879:0:15620:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788390497.368885:0:15620:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788390497.368891:0:15620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390497.368897:0:15620:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788390497.368902:0:15620:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff984fb7b819b8) has no exports 00000020:00080000:0.0:1788390497.368927:0:15620:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff984fb7b819b8) has no exports 00010000:00010000:3.0:1788390497.369154:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788390497.377795:0:15620:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984f87e9a6c0 - data ffff984fb272dd80/ffff984fbb3a9c00 00000020:01000000:0.0:1788390497.377975:0:15620:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984e8659e660 - data ffff984fb2444948/ffff984e865c6000 00100000:10000000:2.0:1788390497.402500:0:15620:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788390497.407675:0:15620:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97359 00000020:00000080:3.0:1788390497.407688:0:15620:0:(genops.c:885:class_export_put()) final put ffff984fbb3b8000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788390497.407707:0:15620:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fb7b73800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788390497.407711:0:15620:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fb7b73800 2 00000020:01000004:3.0:1788390497.407715:0:15620:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff984fb7b73800 from lustre-OST0000 00000020:00000080:3.0:1788390497.407740:0:15620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390497.407749:0:15620:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788390497.407752:0:15620:0:(genops.c:885:class_export_put()) final put ffff984fbb3b9800/lustre-OST0000_UUID 00000020:00000080:3.0:1788390497.407756:0:15620:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbb3b9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788390497.407763:0:15620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788390497.407821:0:15620:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788390497.407826:0:15620:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788390497.407829:0:15620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390497.407835:0:15620:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788390497.407841:0:15620:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff984e85f3c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390497.407848:0:15620:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff984fbaf80000) has exports, disconnecting them 00000020:00080000:3.0:1788390497.407853:0:15620:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff984e85f3c000), last request at 1788390327 00000020:00000080:3.0:1788390497.407857:0:15620:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97383 00000020:00080000:3.0:1788390497.407868:0:15620:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984e85f3c000): rc 0 00000020:00000080:3.0:1788390497.407873:0:15620:0:(genops.c:885:class_export_put()) final put ffff984e85f3c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788390497.408183:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbb3b8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788390497.408192:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984e85f3c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788390497.415422:0:15620:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788390497.415432:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390497.415436:0:15620:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788390497.415443:0:15620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390497.415671:0:15620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390497.415680:0:15620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788390497.415689:0:15620:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788390497.415694:0:15620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390497.415698:0:15620:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788390497.415706:0:15620:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff984e85f39000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390497.415714:0:15620:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff984fbac099b8) has exports, disconnecting them 00000020:00080000:0.0:1788390497.415719:0:15620:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff984e85f39000), last request at 1788390327 00000020:00000080:0.0:1788390497.415724:0:15620:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97398 00000020:00080000:0.0:1788390497.415752:0:15620:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984e85f39000): rc 0 00000020:00000080:0.0:1788390497.415758:0:15620:0:(genops.c:885:class_export_put()) final put ffff984e85f39000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788390497.416732:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e85f76000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788390497.416743:0:37:0:(genops.c:885:class_export_put()) final put ffff984e85f73800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788390497.416746:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984e85f73800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788390497.416752:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788390497.416816:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984e85f39000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788390497.416846:0:15620:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788390497.416849:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788390497.416853:0:15620:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788390497.416857:0:15620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788390497.416874:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e85f3c800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788390497.417032:0:15620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390497.417038:0:15620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788390497.417041:0:15620:0:(genops.c:885:class_export_put()) final put ffff984e85f38000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788390497.417044:0:15620:0:(genops.c:844:class_export_destroy()) destroying export ffff984e85f38000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788390497.417049:0:15620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788390497.417106:0:15620:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fb7b73800 1 00000020:00000080:1.0:1788390497.417113:0:15620:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be97321 00000020:00000080:1.0:1788390497.417117:0:15620:0:(genops.c:885:class_export_put()) final put ffff984fb78a1800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788390497.417125:0:15620:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788390497.417133:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb78a1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788390497.417142:0:15620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390497.417146:0:15620:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788390497.417149:0:15620:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff984fb7b84d28) has no exports 00000020:00000080:1.0:1788390497.444299:0:15620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390497.444315:0:15620:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788390497.444425:0:15620:0:(genops.c:885:class_export_put()) final put ffff984fb7b76000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788390497.444431:0:15620:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7b76000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788390497.444443:0:15620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788390497.444594:0:15620:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff984fb7b71000 00000020:02000400:1.0:1788390497.444641:0:15620:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788390497.484618:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390498.514815:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788390499.410949:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788390499.410958:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788390499.410960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788390499.410962:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788390499.411031:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390499.411051:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263098065280:0@lo:400:kworker.0 00000400:00000100:0.0:1788390499.411105:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263098065280 offset 0 length 224: 4 00010000:00010000:2.0:1788390499.540143:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788390500.014241:0:15822:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788390500.026520:0:15822:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788390500.026614:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390500.026647:0:15822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390500.026654:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390500.026660:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390500.026682:0:15822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788390500.026727:0:15822:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788390500.026754:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390500.026766:0:15822:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e883ad180 x1875263098064640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788390509 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390500.026790:0:15822:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788390500.026798:0:15822:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788390500.026805:0:15822:0:(import.c:65:import_set_state_nolock()) ffff984e876bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788390500.026812:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390500.026816:0:15822:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e883ad180 x1875263098064640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788390509 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390500.026824:0:15822:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788390500.026828:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:2.0:1788390500.026919:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390500.026928:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390500.026936:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390500.026940:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390500.026948:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390500.026957:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390500.026963:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788390500.026966:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788390500.026968:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788390500.027053:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984f862ae800 00010000:00010000:2.0:1788390500.027058:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390500.027065:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf735200/0xe156d0713be975dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be975e4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390500.027078:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390500.027080:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390500.027092:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390500.027154:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263098064640:0@lo:38:kworker.0 00000100:00080000:3.0:1788390500.028815:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788390500.028828:0:15822:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e883aca80 x1875263098064768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390505 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390500.028910:0:15822:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e883aea00 x1875263098064896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390506 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390500.028954:0:15822:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e88adf800 x1875263098065024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390510 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390500.028963:0:15822:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e88b21c00 x1875263098065280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390500.028970:0:15822:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788390500.028985:0:15822:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788390500.029008:0:15822:0:(import.c:65:import_set_state_nolock()) ffff984e877d3000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788390500.029178:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098065024:0@lo:400:kworker.0 00000100:00100000:1.0:1788390500.029188:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098064896:0@lo:400:kworker.0 00000100:00100000:0.0:1788390500.029238:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263098064768:0@lo:400:kworker.0 00000100:00100000:0.0:1788390500.029256:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3623:1875263098065280:0@lo:400:kworker.0 00000100:00100000:2.0:1788390500.029303:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1875263098065408:0@lo:39:umount.0 00000400:00000100:0.0:1788390500.030682:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263098065408 offset 0 length 224: 4 00010000:00010000:0.0:1788390500.564791:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390501.585659:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390502.609483:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390503.633528:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788390504.530792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788390504.530806:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788390504.657580:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390505.682664:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390506.706876:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390507.729649:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390508.753641:0:13156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390509.265454:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390494/real 1788390494] req@ffff984e88adf100 x1875263098065152/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788390509 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390509.265513:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e88adf100 x1875263098065152/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788390509 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788390509.265535:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f862ae800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390509.265624:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788390509.265629:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13bece9d-37f8-46e7-9f27-a320529bc20d:3621:1875263098065152:0@lo:250:kworker.0 00000100:00080000:0.0:1788390509.265703:0:480:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788390509.265708:0:480:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788390509.265712:0:480:0:(import.c:65:import_set_state_nolock()) ffff984f862ae800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390509.265907:0:480:0:(import.c:510:import_select_connection()) MGC192.168.202.111@tcp: connect to NID 0@lo last attempt 314 00000100:00080000:0.0:1788390509.267096:0:480:0:(import.c:589:import_select_connection()) MGC192.168.202.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788390509.267104:0:480:0:(import.c:624:import_select_connection()) MGC192.168.202.111@tcp: import ffff984f862ae800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390509.267142:0:480:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88b21c00 x1875263098065536/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390509.267230:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13bece9d-37f8-46e7-9f27-a320529bc20d:3621:1875263098065536:0@lo:250:kworker.0 00000400:00000100:1.0:1788390509.267294:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263098065536 offset 0 length 520: 4 00010000:00010000:3.0:1788390509.777677:0:13157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390510.289674:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390500/real 1788390500] req@ffff984e88add500 x1875263098065408/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788390510 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390510.289709:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e88add500 x1875263098065408/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788390510 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788390510.289727:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e877d3000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788390510.289750:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1875263098065408:0@lo:39:umount.0 00000100:00080000:3.0:1788390510.292432:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788390510.292441:0:15822:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788390510.292450:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788390510.293310:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390510.293367:0:15822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390510.293375:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390510.293382:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390510.293427:0:15822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390510.293435:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390510.293442:0:15822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390510.293449:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390510.293455:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390510.293486:0:15822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788390510.293491:0:15822:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788390510.293516:0:15822:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788390510.293524:0:15822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788390510.293529:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390510.293534:0:15822:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788390510.293537:0:15822:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff984e87428000) has no exports 00000020:00080000:3.0:1788390510.293558:0:15822:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff984e87428000) has no exports 00000020:01000000:3.0:1788390510.295255:0:15822:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984f87e9a240 - data ffff984fb2730438/ffff984e87996000 00000020:01000000:3.0:1788390510.296681:0:15822:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984e87a27ae0 - data ffff984fb2744a20/ffff984e86afe000 00010000:00010000:2.0:1788390510.296937:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390510.296948:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390510.296960:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734c00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390510.296965:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390510.296976:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390510.296983:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390510.296989:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788390510.296992:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788390510.296995:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788390510.297014:0:6480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984f862ae800 00010000:00010000:2.0:1788390510.297019:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390510.297027:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbf734c00/0xe156d0713be975eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be975f2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390510.297042:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390510.297047:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390510.297072:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4e00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390510.297075:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390510.297082:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390510.297094:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390510.297100:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788390510.297102:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788390510.297105:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788390510.297111:0:6480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984f862ae800 00010000:00010000:2.0:1788390510.297114:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390510.297120:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4e00/0xe156d0713be97868 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be9786f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390510.297134:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390510.297136:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390510.297138:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390510.297560:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788390510.307117:0:15822:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788390510.328458:0:15822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9747f 00000020:00000080:3.0:1788390510.328492:0:15822:0:(genops.c:885:class_export_put()) final put ffff984f88c47000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788390510.328527:0:15822:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fc18b3800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788390510.328533:0:15822:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fc18b3800 2 00000020:01000004:3.0:1788390510.328538:0:15822:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff984fc18b3800 from lustre-OST0001 00000020:00000080:1.0:1788390510.328554:0:480:0:(genops.c:844:class_export_destroy()) destroying export ffff984f88c47000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788390510.328607:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390510.328623:0:15822:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788390510.328627:0:15822:0:(genops.c:885:class_export_put()) final put ffff984fbb065000/lustre-OST0001_UUID 00000020:00000080:3.0:1788390510.328630:0:15822:0:(genops.c:844:class_export_destroy()) destroying export ffff984fbb065000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788390510.328644:0:15822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788390510.328847:0:15822:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 13bece9d-37f8-46e7-9f27-a320529bc20d->MGS 00010000:00010000:3.0:1788390510.328997:0:15822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f8a5cfc00/0xe156d0713be971d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be971df expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390510.329014:0:15822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f8a5cfc00/0xe156d0713be971d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be971df expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390510.329022:0:15822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788390510.329026:0:15822:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788390510.329122:0:15822:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788390510.329146:0:15822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984f862ae800 00010000:00010000:3.0:1788390510.329151:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f8a5cfc00/0xe156d0713be971d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be971df expref: -99 pid: 7422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390510.329171:0:15822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe156d0713be97654 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390510.329177:0:15822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe156d0713be97654 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390510.329182:0:15822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788390510.329185:0:15822:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788390510.329187:0:15822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788390510.329197:0:15822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984f862ae800 00010000:00010000:3.0:1788390510.329200:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f846d4800/0xe156d0713be9764d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe156d0713be97654 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788390510.329237:0:15822:0:(import.c:65:import_set_state_nolock()) ffff984f862ae800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788390510.329243:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788390510.329245:0:15822:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788390510.329247:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788390510.329253:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788390510.329266:0:15822:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984e88b21c00 x1875263098065536/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788390529 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788390510.329295:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788390510.329299:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1788390510.329497:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13bece9d-37f8-46e7-9f27-a320529bc20d:3621:1875263098065536:0@lo:250:kworker.0 10000000:01000000:3.0:1788390510.329546:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788390510.329562:0:15822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be970d5 00000020:00000080:3.0:1788390510.329573:0:15822:0:(genops.c:885:class_export_put()) final put ffff984f894eb000/13bece9d-37f8-46e7-9f27-a320529bc20d 00000020:01000000:3.0:1788390510.329635:0:15822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.111@tcp (flags='') 00000020:00000080:3.0:1788390510.329642:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390510.329651:0:15822:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788390510.329655:0:15822:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff984f88c4cd28) has no exports 10000000:01000000:0.0:1788390510.329731:0:6489:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788390510.329829:0:15822:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.111@tcp: client import never connected 00000100:00080000:3.0:1788390510.329834:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788390510.329837:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788390510.329840:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788390510.329842:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788390510.329887:0:480:0:(genops.c:844:class_export_destroy()) destroying export ffff984f894eb000/13bece9d-37f8-46e7-9f27-a320529bc20d for MGC192.168.202.111@tcp 00000020:00000080:1.0:1788390510.332166:0:480:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984f862ae800 for MGC192.168.202.111@tcp 00000020:00000080:0.0:1788390510.332253:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390510.332264:0:15822:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.111@tcp (uuid 13bece9d-37f8-46e7-9f27-a320529bc20d) 00000020:00000080:0.0:1788390510.332269:0:15822:0:(genops.c:885:class_export_put()) final put ffff984f85b1e800/13bece9d-37f8-46e7-9f27-a320529bc20d 00000020:00000080:0.0:1788390510.332273:0:15822:0:(genops.c:844:class_export_destroy()) destroying export ffff984f85b1e800/13bece9d-37f8-46e7-9f27-a320529bc20d for MGC192.168.202.111@tcp 00000020:01000000:0.0:1788390510.332287:0:15822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.111@tcp (13bece9d-37f8-46e7-9f27-a320529bc20d) 00000020:01000000:0.0:1788390510.332653:0:15822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788390510.332658:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390510.332664:0:15822:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788390510.332671:0:15822:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff984e876b8000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390510.332678:0:15822:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff984fbac0cd28) has exports, disconnecting them 00000020:00080000:0.0:1788390510.332682:0:15822:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff984e876b8000), last request at 1788390346 00000020:00000080:0.0:1788390510.332687:0:15822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be974a9 00000020:00080000:0.0:1788390510.332700:0:15822:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984e876b8000): rc 0 00000020:00000080:0.0:1788390510.332706:0:15822:0:(genops.c:885:class_export_put()) final put ffff984e876b8000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788390510.333387:0:480:0:(genops.c:844:class_export_destroy()) destroying export ffff984e876b8000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788390510.333408:0:15822:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788390510.333413:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788390510.333417:0:15822:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788390510.333422:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788390510.333598:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390510.333604:0:15822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788390510.333609:0:15822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788390510.333612:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390510.333616:0:15822:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788390510.333620:0:15822:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff984e877d3800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788390510.333624:0:15822:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff984e874299b8) has exports, disconnecting them 00000020:00080000:1.0:1788390510.333628:0:15822:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff984e877d3800), last request at 1788390346 00000020:00000080:1.0:1788390510.333642:0:15822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be974be 00000020:00080000:1.0:1788390510.333653:0:15822:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984e877d3800): rc 0 00000020:00000080:1.0:1788390510.333657:0:15822:0:(genops.c:885:class_export_put()) final put ffff984e877d3800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788390510.334317:0:480:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e876bc000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788390510.334334:0:480:0:(genops.c:885:class_export_put()) final put ffff984e876ba000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788390510.334337:0:480:0:(genops.c:844:class_export_destroy()) destroying export ffff984e876ba000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788390510.334341:0:480:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788390510.334391:0:480:0:(genops.c:844:class_export_destroy()) destroying export ffff984e877d3800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788390510.341541:0:15822:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788390510.341551:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788390510.341555:0:15822:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788390510.341563:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788390510.341685:0:13156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788390510.341831:0:13157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:3.0:1788390510.341926:0:480:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984e877d3000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788390510.341957:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788390510.342088:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1788390510.344265:0:10310:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff984e86beae00:10310] 2 exiting: rc = 0 00000100:00100000:2.0:1788390510.344365:0:13700:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff984e881a3000:13700] 3 exiting: rc = 0 00000100:00100000:2.0:1788390510.344423:0:6476:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff984fb6070e00:6476] 1 exiting: rc = 0 00000100:00100000:2.0:1788390510.344490:0:6475:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff984f9893d000:6475] 0 exiting: rc = 1 00000100:00100000:3.0:1788390510.344586:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.344836:0:6479:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff984faefcde00:6479] 2 exiting: rc = 0 00000100:00100000:0.0:1788390510.345564:0:10369:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff984fb76d3400:10369] 3 exiting: rc = 0 00000100:00100000:2.0:1788390510.345749:0:6478:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff984fb6071a00:6478] 1 exiting: rc = 0 00000100:00100000:2.0:1788390510.345806:0:6477:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff984fb6071600:6477] 0 exiting: rc = 1 00000100:00100000:3.0:1788390510.346538:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346546:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346552:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346558:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346565:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346571:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346577:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346584:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346589:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346594:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346600:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346605:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346612:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346618:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346624:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346630:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346635:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346648:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346654:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346660:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346668:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346674:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346679:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346684:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346689:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346694:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346700:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346705:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346711:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346716:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346721:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346726:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346731:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346736:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346756:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346760:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346765:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346770:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346777:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346783:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346788:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346793:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346798:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346803:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346808:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346813:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346818:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346823:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346829:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346835:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346840:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346845:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346850:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346854:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346859:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346877:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346883:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346888:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346894:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346899:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346904:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346909:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346915:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390510.346920:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788390510.347963:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390510.347971:0:15822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788390510.347976:0:15822:0:(genops.c:885:class_export_put()) final put ffff984f88c41000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788390510.347979:0:15822:0:(genops.c:844:class_export_destroy()) destroying export ffff984f88c41000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788390510.347983:0:15822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788390510.348037:0:15822:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fc18b3800 1 00000020:00000080:3.0:1788390510.348043:0:15822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe156d0713be9744e 00000020:00000080:3.0:1788390510.348049:0:15822:0:(genops.c:885:class_export_put()) final put ffff984fc18fa800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788390510.348090:0:15822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788390510.348093:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390510.348096:0:15822:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788390510.348099:0:15822:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff984fbac0b370) has no exports 00000020:00000080:2.0:1788390510.350576:0:480:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc18fa800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788390510.364123:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390510.364139:0:15822:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788390510.364145:0:15822:0:(genops.c:885:class_export_put()) final put ffff984fc18b2000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788390510.364149:0:15822:0:(genops.c:844:class_export_destroy()) destroying export ffff984fc18b2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788390510.364156:0:15822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788390510.367209:0:15822:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff984fc18b2800 00000020:01000000:0.0:1788390510.367248:0:15822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788390510.367254:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390510.367259:0:15822:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788390510.367264:0:15822:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff984fb7b80000) has no exports 00000020:00000080:0.0:1788390510.367295:0:15822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390510.367310:0:15822:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788390510.367315:0:15822:0:(genops.c:885:class_export_put()) final put ffff984fb7b72800/OSS_uuid 00000020:00000080:0.0:1788390510.367339:0:15822:0:(genops.c:844:class_export_destroy()) destroying export ffff984fb7b72800/OSS_uuid for OSS 00000020:01000000:0.0:1788390510.367344:0:15822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788390510.367414:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff984fbaf21000:8407] 0 exiting: rc = 1 00000100:00080000:3.0:1788390510.367576:0:6488:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788390510.367680:0:8798:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff984fb7afc200:8798] 3 exiting: rc = 0 00000100:00100000:3.0:1788390510.367799:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff984fbaf25000:8408] 1 exiting: rc = 0 00000100:00100000:3.0:1788390510.367858:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff984fbaf25600:8409] 2 exiting: rc = 0 00000100:00100000:1.0:1788390510.368029:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368044:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368052:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368059:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368064:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368069:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368074:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368079:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368084:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368090:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368096:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368101:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368107:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368112:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368118:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368124:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368129:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368135:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368140:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368146:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368151:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368157:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368162:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368167:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368173:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368179:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368184:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368189:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368194:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368199:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368203:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368216:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368221:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368227:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368291:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368298:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368303:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368314:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368400:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368405:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368411:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368417:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368423:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368428:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368434:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368439:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368444:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368449:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368454:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368464:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368482:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368492:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368498:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368504:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368509:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368514:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368519:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368524:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368529:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368534:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368539:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368544:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368549:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.368553:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.369549:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff984fbaf24400:8411] 1 exiting: rc = 0 00000100:00100000:3.0:1788390510.369558:0:10071:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff984e86ba4000:10071] 2 exiting: rc = 0 00000100:00100000:0.0:1788390510.369644:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff984fbaf24000:8410] 0 exiting: rc = 1 00000100:00100000:1.0:1788390510.369723:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369730:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369745:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369750:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369756:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369761:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369766:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369777:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369784:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369789:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369794:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369800:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369806:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369811:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369816:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369821:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369826:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369832:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369837:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369843:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369847:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369852:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369856:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369862:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369867:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369873:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369879:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369884:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369890:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369895:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369899:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369903:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369906:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369909:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369912:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369915:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369918:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369927:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369930:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369933:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369937:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369940:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369943:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369946:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369950:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369952:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369955:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369958:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369961:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369964:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369967:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369970:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369973:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369976:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369979:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369981:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369985:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369987:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369992:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.369997:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.370002:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.370006:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.370010:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.370020:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.370936:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff984f89f52000:8414] 2 exiting: rc = 0 00000100:00100000:0.0:1788390510.371374:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff984fbaf25200:8412] 0 exiting: rc = 1 00000100:00100000:3.0:1788390510.371597:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff984fbaf21200:8413] 1 exiting: rc = 0 00000100:00100000:0.0:1788390510.371779:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371787:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371793:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371799:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371804:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371811:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371817:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371823:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371829:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371835:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371840:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371845:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371850:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371855:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371860:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371866:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371872:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371878:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371884:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371889:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371895:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371901:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371908:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371925:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371932:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371938:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371944:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371961:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371966:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371971:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371977:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371983:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371989:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371994:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.371999:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372005:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372010:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372015:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372021:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372027:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372033:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372039:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372044:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372055:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372061:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372066:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372071:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372090:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372097:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372103:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372108:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372113:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372119:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372124:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372130:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372145:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372151:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372157:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372170:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372184:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372191:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372197:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372210:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390510.372216:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.376772:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff984fb76c9a00:8416] 1 exiting: rc = 0 00000100:00100000:3.0:1788390510.376817:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff984fba710800:8415] 0 exiting: rc = 1 00000100:00100000:1.0:1788390510.376967:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.376975:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.376981:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.376986:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377001:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377007:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377012:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377031:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377037:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377043:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377048:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377053:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377058:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377063:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377068:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377074:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377102:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377110:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377115:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377119:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377124:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377129:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377134:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377138:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377143:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377148:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377153:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377159:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377164:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377168:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377174:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377179:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377185:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377191:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377196:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377201:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377207:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377212:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377217:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377222:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377226:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377230:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377253:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377258:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377263:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377267:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377272:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377278:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377284:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377290:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377300:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377305:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377310:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377315:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377391:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377398:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377403:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377408:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377414:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377419:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377424:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377432:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377437:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390510.377442:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378440:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff984fb789ca00:8417] 0 exiting: rc = 1 00000100:00100000:1.0:1788390510.378550:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff984fb789d600:8418] 1 exiting: rc = 0 00000100:00100000:2.0:1788390510.378721:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378727:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378734:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378740:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378760:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378769:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378775:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378781:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378787:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378793:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378800:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378806:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378812:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378819:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378824:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378909:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378930:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378939:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378945:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378951:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378957:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378975:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378981:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378988:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.378995:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379000:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379006:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379012:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379032:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379039:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379045:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379050:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379056:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379062:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379069:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379075:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379081:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379087:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379093:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379099:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379119:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379126:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379132:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379137:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379143:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379149:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379155:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379161:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379166:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379172:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379179:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379676:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379700:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379706:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379711:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379716:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379728:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379733:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379739:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379744:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379750:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379755:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379762:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390510.379768:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788390510.388921:0:15822:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788390523.192289:0:16588:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788390529.865587:0:17188:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788390529.865594:0:17188:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788390529.865595:0:17188:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788390529.865698:0:17188:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984fa27ae800 00000020:01000004:3.0:1788390529.865712:0:17188:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788390529.865718:0:17188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788390529.865731:0:17188:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff984fbaf819b8) 00000020:00000080:3.0:1788390529.865744:0:17188:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788390529.905816:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788390529.912031:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.913073:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788390529.913590:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788390529.913970:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.914671:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.915463:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.916616:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788390529.916903:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.917084:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.917286:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788390529.917563:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788390529.917751:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.917924:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788390529.920456:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.920889:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.921090:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.921607:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.921864:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.922112:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.922421:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.922687:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.922960:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.923155:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.923544:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.923757:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.924017:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.924262:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.924484:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.924675:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.924866:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.925092:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.925349:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.925586:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.925772:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.926039:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.926212:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.926447:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.926631:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.926859:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.927097:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.927410:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.927599:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.927803:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.928017:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.928222:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788390529.928435:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788390529.929626:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.930013:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.930204:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.930598:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.930844:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788390529.931031:0:17188:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1788390529.931573:0:17188:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788390529.931984:0:17188:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788390529.931992:0:17188:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788390529.932004:0:17188:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be98692 00000020:01000004:2.0:1788390529.932011:0:17188:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788390529.932016:0:17188:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788390529.932021:0:17188:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984fa27ae800 from MGS 00000020:01000004:2.0:1788390529.932025:0:17188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788390529.932035:0:17188:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff984fbac0b370) 00000020:00000080:2.0:1788390529.932047:0:17188:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788390529.932116:0:17188:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fa27ae800 from MGS, refs=2 00080000:01000000:2.0:1788390529.932121:0:17188:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788390529.932126:0:17188:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be986a0 00000100:00100000:2.0:1788390529.932226:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788390529.932396:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788390529.932403:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788390529.932833:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788390529.932840:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788390529.933575:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390529.933710:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788390529.933715:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788390529.934152:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788390529.934159:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788390529.934598:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788390529.934605:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788390529.935086:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390529.935088:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390529.935090:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390529.937650:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390529.937656:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390529.937658:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390529.938103:0:17188:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788390529.939750:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788390529.942058:0:17188:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788390529.942799:0:17200:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788390529.942843:0:17188:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788390529.942879:0:17188:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788390529.943550:0:17188:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788390529.943881:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390529.944038:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788390529.944045:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788390529.944547:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788390529.944558:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788390529.949688:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788390529.949701:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788390529.950400:0:17205:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788390529.950441:0:17188:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788390529.950463:0:17188:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.111@tcp' 00000020:01000004:2.0:1788390529.950471:0:17188:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788390529.950503:0:17188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.111@tcp (typ=mgc) 00000020:00000080:2.0:1788390529.950516:0:17188:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.111@tcp (ffff984fbac0cd28) 00000020:00000080:2.0:1788390529.950531:0:17188:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788390529.950603:0:17188:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984f90ebf000@MGC192.168.202.111@tcp: add connection 192.168.202.111@tcp at head 00010000:00010000:2.0:1788390529.950743:0:17188:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.111@tcp-0 is initialized 00000040:01000000:2.0:1788390529.950749:0:17188:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788390529.955823:0:17206:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788390529.955905:0:17188:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.111@tcp (uuid a9c7a63f-cc02-4e88-ac45-45156e5cf29e) 00000020:00000080:0.0:1788390529.955930:0:17188:0:(genops.c:1385:class_connect()) connect: client a9c7a63f-cc02-4e88-ac45-45156e5cf29e, cookie 0xe156d0713be986ae 00000100:00080000:0.0:1788390529.955942:0:17188:0:(import.c:510:import_select_connection()) MGC192.168.202.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390529.955948:0:17188:0:(import.c:624:import_select_connection()) MGC192.168.202.111@tcp: import ffff984f90ebf000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390529.955983:0:17188:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88b23100 x1875263098065664/t0(0) o250->MGC192.168.202.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788390529.956012:0:17188:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a9c7a63f-cc02-4e88-ac45-45156e5cf29e->MGS 00000020:01000004:0.0:1788390529.956074:0:17188:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788390529.956080:0:17188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788390529.956093:0:17188:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff984fbac40000) 00000020:00000080:0.0:1788390529.956108:0:17188:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788390529.959431:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3621:1875263098065664:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788390529.959518:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390529.959568:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098065664 00000100:00100000:2.0:1788390529.959578:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098065664 00000100:00100000:2.0:1788390529.959619:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390529.959626:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3621:x1875263098065664:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788390529.959653:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a9c7a63f-cc02-4e88-ac45-45156e5cf29e@0@lo t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:2.0:1788390529.959684:0:17201:0:(genops.c:1385:class_connect()) connect: client a9c7a63f-cc02-4e88-ac45-45156e5cf29e, cookie 0xe156d0713be986bc 00000100:00080000:2.0:1788390529.959874:0:17201:0:(import.c:65:import_set_state_nolock()) ffff984f851a1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390529.959944:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+5:3621:x1875263098065664:12345-0@lo:250:mount.lustre.0 Request processed in 314us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390529.959954:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390529.960023:0:3621:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788390529.960033:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.111@tcp: connect to target with instance 0 00000100:00080000:2.0:1788390529.960043:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788390529.960049:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788390529.960053:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f90ebf000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788390529.960057:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788390529.960068:0:3621:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788390529.960076:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3621:1875263098065664:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788390529.966759:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390529.966889:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788390529.966893:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788390529.967317:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390529.967442:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788390529.967774:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788390529.967781:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788390529.968476:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390529.968635:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788390529.968641:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788390529.969460:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788390529.969468:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788390529.992469:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390529.992684:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788390529.992690:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788390529.993668:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788390529.993681:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788390529.994504:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390529.994644:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788390529.994648:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788390529.995222:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788390529.995232:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788390529.995826:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390529.995952:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788390529.995956:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788390529.996471:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788390529.996478:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788390529.996965:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390529.997093:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788390529.997100:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788390529.997745:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788390529.997750:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788390530.010918:0:17188:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390530.011082:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788390530.011086:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788390530.012037:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788390530.012043:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788390530.014124:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788390530.014138:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788390530.014914:0:17188:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788390530.014942:0:17188:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788390530.014948:0:17188:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788390530.015047:0:17188:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788390530.015081:0:17188:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.111@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788390530.015085:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788390530.015087:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788390530.015088:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390530.015089:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390530.015091:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390530.015091:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390530.015093:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788390530.015094:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788390530.015096:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390530.015097:0:17188:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390530.015100:0:17188:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788390530.015102:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788390530.015107:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788390530.015109:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390530.015110:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390530.015111:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390530.015112:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390530.015113:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788390530.015114:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788390530.015114:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390530.015115:0:17188:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390530.015141:0:17188:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788390530.015159:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098065792:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788390530.015224:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390530.015273:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90f66f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390530.015408:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098065792 00000100:00100000:0.0:1788390530.015415:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098065792 00000100:00100000:0.0:1788390530.015461:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390530.015470:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+5:17188:x1875263098065792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788390530.015513:0:17204:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788390530.015517:0:17204:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788390530.015519:0:17204:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788390530.015873:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788390530.016274:0:17204:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788390530.017445:0:17226:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788390530.017449:0:17226:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788390530.017451:0:17226:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788390530.017453:0:17226:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788390530.017608:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788390530.017773:0:17204:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788390530.017780:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788390530.019058:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+5:17188:x1875263098065792:12345-0@lo:253:mount.lustre.0 Request processed in 3583us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390530.019070:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390530.019152:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098065792:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788390530.019166:0:17188:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788390530.019169:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788390530.019171:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788390530.019172:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390530.019173:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390530.019174:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390530.019175:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390530.019176:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788390530.019178:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788390530.019179:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390530.019181:0:17188:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788390530.019201:0:17188:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984fa27ae800 from lustre-MDT0000 10000000:01000000:2.0:1788390530.019226:0:17188:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788390530.019229:0:17188:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788390530.019233:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff984fbac0cd28 10000000:01000000:2.0:1788390530.019237:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788390530.019244:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984fbac0cd28 from 1 10000000:01000000:2.0:1788390530.019247:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788390530.019284:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.019318:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.019421:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390530.019441:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098065920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788390530.019481:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390530.019514:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098065920 00000100:00100000:2.0:1788390530.019519:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098065920 00000100:00100000:2.0:1788390530.019553:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390530.019562:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+5:17188:x1875263098065920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390530.019572:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390530.019585:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e87ba1200/0xe156d0713be986ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be986c3 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.019605:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e87ba1200/0xe156d0713be986ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be986c3 expref: 6 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.019614:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e87ba1200/0xe156d0713be986ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be986c3 expref: 6 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.019622:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1200, rc 0) 00000100:00100000:2.0:1788390530.019645:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+6:17188:x1875263098065920:12345-0@lo:101:mount.lustre.0 Request processed in 85us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390530.019651:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390530.019687:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90f66e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390530.019705:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098065920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390530.019716:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.019724:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390530.019783:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390530.019912:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390530.019959:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90f66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390530.020001:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098066048 00000100:00100000:0.0:1788390530.020005:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098066048 00000100:00100000:0.0:1788390530.020067:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390530.020074:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+6:17188:x1875263098066048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390530.020144:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+6:17188:x1875263098066048:12345-0@lo:501:mount.lustre.0 Request processed in 71us (232us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390530.020152:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390530.020208:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066048:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788390530.020234:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788390530.020251:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.020260:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390530.020267:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984fa27ae800 10000000:01000000:3.0:1788390530.020271:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788390530.020275:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff984fa27ae800 10000000:01000000:3.0:1788390530.020278:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788390530.020280:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff984fa27ae800 from 1 10000000:01000000:3.0:1788390530.020283:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788390530.020309:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be986d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.020317:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be986d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.020350:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be986d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390530.020379:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390530.020406:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390530.020582:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90f65b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390530.020609:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098066176 00000100:00100000:2.0:1788390530.020614:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098066176 00000100:00100000:2.0:1788390530.020634:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390530.020640:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+6:17188:x1875263098066176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390530.020646:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390530.020656:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e87ba0400/0xe156d0713be986d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be986d1 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.020669:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e87ba0400/0xe156d0713be986d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be986d1 expref: 7 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.020677:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e87ba0400/0xe156d0713be986d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be986d1 expref: 7 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.020683:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba0400, rc 0) 00000100:00100000:2.0:1788390530.020751:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+7:17188:x1875263098066176:12345-0@lo:101:mount.lustre.0 Request processed in 111us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390530.020758:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390530.020901:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390530.020912:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be986d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986d8 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.020920:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be986d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be986d8 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390530.020931:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788390530.020982:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be986d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986d8 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.020990:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cea00/0xe156d0713be986d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986d8 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390530.020996:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788390530.021000:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390530.021004:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff984fa27ae800 10000000:01000000:3.0:1788390530.021007:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788390530.021010:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788390530.021012:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788390530.021026:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be986df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.021032:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be986df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.021038:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be986df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390530.021061:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390530.021086:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390530.021107:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90f65b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390530.021155:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098066304 00000100:00100000:2.0:1788390530.021160:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098066304 00000100:00100000:2.0:1788390530.021191:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390530.021198:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+7:17188:x1875263098066304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390530.021205:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390530.021212:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e87ba0200/0xe156d0713be986e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be986df expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.021223:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e87ba0200/0xe156d0713be986e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be986df expref: 8 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.021230:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e87ba0200/0xe156d0713be986e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be986df expref: 8 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390530.021236:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba0200, rc 0) 00000100:00100000:2.0:1788390530.021272:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+8:17188:x1875263098066304:12345-0@lo:101:mount.lustre.0 Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390530.021278:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390530.021423:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390530.021433:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be986df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986e6 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390530.021440:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be986df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be986e6 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390530.021483:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390530.021515:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390530.021531:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984facfbb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788390530.021581:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098066432 00000100:00100000:2.0:1788390530.021585:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098066432 00000100:00100000:2.0:1788390530.021644:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390530.021652:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+8:17188:x1875263098066432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390530.021770:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+9:17188:x1875263098066432:12345-0@lo:501:mount.lustre.0 Request processed in 119us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390530.021777:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390530.021837:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390530.021863:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390530.021899:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390530.022091:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984facfbb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390530.022134:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098066560 00000100:00100000:3.0:1788390530.022139:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098066560 00000100:00100000:3.0:1788390530.022160:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390530.022166:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+9:17188:x1875263098066560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390530.022912:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+9:17188:x1875263098066560:12345-0@lo:503:mount.lustre.0 Request processed in 744us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390530.022923:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390530.023052:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098066560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788390530.023504:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17227:1875263098066688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390530.023540:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390530.023600:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f90f66300 going to sleep for 11 seconds 00000100:00100000:3.0:1788390530.023639:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098066688 00000100:00100000:3.0:1788390530.023643:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098066688 00000100:00100000:3.0:1788390530.023701:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390530.023710:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+9:17227:x1875263098066688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390530.024153:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+9:17227:x1875263098066688:12345-0@lo:502:llog_process_th.0 Request processed in 442us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390530.024160:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390530.024229:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17227:1875263098066688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788390530.024251:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390530.024262:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390530.024264:0:17227:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788390530.024270:0:17227:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788390530.024273:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788390530.024287:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff984fbac099b8) 00000020:00000080:2.0:1788390530.024312:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788390530.024318:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788390530.024409:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788390530.024416:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be986f4 00000020:00000080:2.0:1788390530.024611:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788390530.024615:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390530.024619:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390530.024620:0:17227:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788390530.024623:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390530.024626:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390530.024627:0:17227:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788390530.024631:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788390530.024637:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff984fbac08000) 00000020:00000080:2.0:1788390530.024645:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788390530.024648:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788390530.024650:0:17227:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788390530.024653:0:17227:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788390530.024658:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788390530.024694:0:17227:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fa27ae800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788390530.024715:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff984fba7119b8) 00000020:00000080:2.0:1788390530.024723:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788390530.024766:0:17227:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788390530.024770:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be98709 00000020:00000080:2.0:1788390530.024867:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788390530.024872:0:17227:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788390530.024881:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe156d0713be98710 00080000:01000000:2.0:1788390530.024886:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788390530.024889:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be98717 00010000:00010000:0.0:1788390530.074652:0:17227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788390530.075041:0:17227:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1788390530.075565:0:17227:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788390530.076004:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff984fbac419b8) 00000020:00000080:0.0:1788390530.076022:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788390530.076101:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788390530.076111:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be98725 00000020:00000080:2.0:1788390530.077367:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788390530.082104:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe156d0713be9872c 00000020:00000080:3.0:1788390530.082563:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788390530.082576:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390530.082584:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.082586:0:17227:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788390530.082590:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788390530.082593:0:17227:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788390530.082595:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390530.082596:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390530.082597:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788390530.082600:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.082607:0:17227:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788390530.082610:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390530.082615:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.082617:0:17227:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788390530.082621:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788390530.082665:0:17227:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788390530.082683:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390530.082685:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.082687:0:17227:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788390530.082689:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390530.082691:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.082693:0:17227:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788390530.082695:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788390530.082700:0:17227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:00000080:3.0:1788390530.082726:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390530.082742:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff984fbaf80000) 00000020:00000080:3.0:1788390530.082754:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788390530.082759:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788390530.082836:0:17227:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788390530.082841:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788390530.082847:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be9873a 00010000:00080000:3.0:1788390530.082875:0:17227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e85f76800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.111@tcp at head 00010000:00010000:3.0:1788390530.084653:0:17227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788390530.085744:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390530.085755:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788390530.085780:0:17227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788390530.085844:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be98741 00000100:00080000:3.0:1788390530.085853:0:17227:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390530.085857:0:17227:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff984e85f76800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390530.085885:0:17227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88aded80 x1875263098066816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390530.085942:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098066816:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788390530.086004:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390530.086052:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098066816 00000100:00080000:3.0:1788390530.086060:0:17227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788390530.086060:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098066816 00000100:00100000:0.0:1788390530.086092:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390530.086100:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1875263098066816:12345-0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788390530.086154:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390530.086159:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.086161:0:17227:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788390530.086164:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788390530.086166:0:17227:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788390530.086168:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390530.086169:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390530.086171:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788390530.086173:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.086174:0:17227:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788390530.086176:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390530.086180:0:17227:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788390530.086183:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.086185:0:17227:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788390530.086188:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788390530.086191:0:17227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:01000000:3.0:1788390530.086208:0:17227:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788390530.086211:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390530.086223:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff984fbaf84d28) 00000020:00000080:3.0:1788390530.086234:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788390530.086239:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00010000:00020000:0.0:1788390530.086270:0:17214:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:3.0:1788390530.086311:0:17227:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788390530.086318:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788390530.086347:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be9874f 00010000:00080000:3.0:1788390530.086374:0:17227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984f8a4f1800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.111@tcp at head 00010000:00010000:3.0:1788390530.086556:0:17227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788390530.087458:0:17227:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788390530.087689:0:17227:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788390530.089516:0:17227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390530.091616:0:17227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788390530.097662:0:17227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788390530.099304:0:17233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390530.099311:0:17233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788390530.100280:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788390530.100303:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788390530.100362:0:17227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788390530.100380:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be98756 00000100:00080000:2.0:1788390530.100391:0:17227:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390530.100396:0:17227:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff984f8a4f1800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390530.100429:0:17227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e883aed80 x1875263098066944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390530.100501:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098066944:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788390530.100552:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263098066944 offset 0 length 520: 4 00000100:00080000:2.0:1788390530.100603:0:17227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788390530.100654:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390530.100658:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390530.100659:0:17227:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788390530.100662:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788390530.100665:0:17227:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788390530.100667:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788390530.100668:0:17227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788390530.100670:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788390530.100672:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390530.100673:0:17227:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788390530.100675:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788390530.100678:0:17227:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788390530.100681:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390530.100682:0:17227:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788390530.100685:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788390530.100697:0:17227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:01000000:2.0:1788390530.100716:0:17227:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788390530.100718:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788390530.100730:0:17227:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff984fba713370) 00000020:00000080:2.0:1788390530.100741:0:17227:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788390530.100745:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788390530.100809:0:17227:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788390530.100815:0:17227:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788390530.100820:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe156d0713be98764 00010000:00080000:2.0:1788390530.100856:0:17227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e877d0800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.111@tcp at head 00010000:00010000:2.0:1788390530.101043:0:17227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788390530.101112:0:17227:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788390530.101128:0:17227:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788390530.104844:0:17227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390530.105097:0:17227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788390530.105241:0:17227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788390530.105617:0:17235:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390530.105622:0:17235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788390530.105977:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1875263098066816:12345-0@lo:38:llog_process_th.0 Request processed in 19872us (19966us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390530.105989:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1788390530.106061:0:17227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390530.106072:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000100:00080000:2.0:1788390530.106073:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e85f76800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788390530.106078:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788390530.106082:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098066816:0@lo:38:llog_process_th.0 00000004:01000000:3.0:1788390530.106120:0:17227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788390530.106137:0:17227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be9876b 00000100:00080000:3.0:1788390530.106142:0:17227:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390530.106146:0:17227:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984e877d0800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390530.106170:0:17227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adea00 x1875263098067072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390530.106189:0:17227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788390530.106212:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098067072:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788390530.106244:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000400:00000100:2.0:1788390530.106244:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263098067072 offset 0 length 520: 4 00000020:00000080:3.0:1788390530.106248:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.106250:0:17227:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788390530.106252:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390530.106256:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.106258:0:17227:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788390530.106260:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390530.106262:0:17227:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788390530.106264:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390530.106267:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.106268:0:17227:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788390530.106270:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390530.106272:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.106273:0:17227:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788390530.106277:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788390530.106318:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17227:1875263098067200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390530.106953:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390530.106978:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb784f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788390530.106993:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098067200 00000100:00100000:2.0:1788390530.106999:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098067200 00000100:00100000:2.0:1788390530.107073:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390530.107083:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+9:17227:x1875263098067200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390530.107257:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+9:17227:x1875263098067200:12345-0@lo:502:llog_process_th.0 Request processed in 175us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390530.107270:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390530.107280:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17227:1875263098067200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788390530.107318:0:17227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390530.107354:0:17227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390530.107356:0:17227:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788390530.107360:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788390530.107505:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788390530.107526:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788390530.107546:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be986df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986e6 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.107559:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cfa00/0xe156d0713be986df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986e6 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390530.107567:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984fa27ae800 from 1 10000000:01000000:1.0:1788390530.107570:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788390530.107598:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.107604:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.107611:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390530.107622:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390530.107645:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390530.107693:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390530.108498:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098067328 00000100:00100000:3.0:1788390530.108506:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098067328 00000100:00100000:3.0:1788390530.108578:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390530.108587:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+9:17188:x1875263098067328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390530.108598:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390530.108613:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98772 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.108636:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98772 expref: 10 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.108646:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98772 expref: 10 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.108654:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfc00, rc 0) 00000100:00100000:3.0:1788390530.108692:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+10:17188:x1875263098067328:12345-0@lo:101:mount.lustre.0 Request processed in 107us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390530.108699:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788390530.108716:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390530.108729:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.108745:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390530.109156:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067456:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788390530.109186:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390530.109212:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390530.109220:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098067456 00000100:00100000:2.0:1788390530.109224:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098067456 00000100:00100000:2.0:1788390530.109282:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390530.109300:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+10:17188:x1875263098067456:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788390530.109314:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788390530.109344:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788390530.109413:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+10:17188:x1875263098067456:12345-0@lo:256:mount.lustre.0 Request processed in 123us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390530.109420:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390530.109438:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067456:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788390530.109906:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788390530.109921:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.109929:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390530.109937:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fa27ae800 from 1 10000000:01000000:1.0:1788390530.109939:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390530.109958:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.109964:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.109969:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390530.109977:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390530.109996:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390530.110022:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390530.110030:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098067584 00000100:00100000:3.0:1788390530.110034:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098067584 00000100:00100000:3.0:1788390530.110068:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390530.110075:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+10:17188:x1875263098067584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390530.110082:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390530.110092:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98780 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.110124:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98780 expref: 11 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.110133:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98780 expref: 11 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390530.110140:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf200, rc 0) 00000100:00100000:3.0:1788390530.110176:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17188:x1875263098067584:12345-0@lo:101:mount.lustre.0 Request processed in 101us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390530.110182:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788390530.110212:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390530.110223:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.110231:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390530.110272:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390530.110288:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390530.110313:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390530.110379:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098067712 00000100:00100000:2.0:1788390530.110383:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098067712 00000100:00100000:2.0:1788390530.110400:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390530.110404:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17188:x1875263098067712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390530.110504:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17188:x1875263098067712:12345-0@lo:501:mount.lustre.0 Request processed in 99us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390530.110511:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390530.110537:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390530.110563:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390530.110601:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390530.110694:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390530.110731:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098067840 00000100:00100000:0.0:1788390530.110736:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098067840 00000100:00100000:0.0:1788390530.110767:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390530.110774:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17188:x1875263098067840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390530.110903:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17188:x1875263098067840:12345-0@lo:503:mount.lustre.0 Request processed in 129us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390530.110910:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390530.110965:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098067840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390530.111307:0:17237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17237:1875263098067968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390530.111361:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390530.111381:0:17237:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017840 going to sleep for 11 seconds 00000100:00100000:0.0:1788390530.111463:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098067968 00000100:00100000:0.0:1788390530.111468:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098067968 00000100:00100000:0.0:1788390530.111520:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390530.111526:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17237:x1875263098067968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390530.111863:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17237:x1875263098067968:12345-0@lo:502:llog_process_th.0 Request processed in 336us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390530.111871:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390530.111896:0:17237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17237:1875263098067968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390530.111915:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390530.111923:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390530.111925:0:17237:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788390530.111931:0:17237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fa27ae800 00000020:00000080:1.0:1788390530.111934:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390530.111941:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390530.111948:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390530.111950:0:17237:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788390530.111953:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390530.111955:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390530.111957:0:17237:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788390530.111960:0:17237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fa27ae800 00000020:00000080:1.0:1788390530.111962:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390530.112021:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390530.112024:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390530.112024:0:17237:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788390530.112026:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390530.112028:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390530.112028:0:17237:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390530.112031:0:17237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fa27ae800 00000020:00000080:1.0:1788390530.112032:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390530.112044:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390530.112045:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390530.112046:0:17237:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390530.112047:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390530.112048:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390530.112049:0:17237:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788390530.112051:0:17237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fa27ae800 00000020:00000080:1.0:1788390530.112052:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788390530.112071:0:17237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17237:1875263098068096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390530.112094:0:17237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390530.112581:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098068096 00000100:00100000:3.0:1788390530.112587:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098068096 00000100:00100000:1.0:1788390530.112587:0:17237:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390530.112653:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788390530.112661:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17237:x1875263098068096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390530.112748:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17237:x1875263098068096:12345-0@lo:502:llog_process_th.0 Request processed in 88us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390530.112755:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390530.112825:0:17237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17237:1875263098068096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390530.112844:0:17237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390530.112849:0:17237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390530.112850:0:17237:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788390530.112858:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788390530.112946:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788390530.112966:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390530.112982:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390530.112993:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390530.113036:0:17188:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788390530.113039:0:17188:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984fa27ae800 10000000:01000000:0.0:1788390530.113042:0:17188:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984fa27ae800 10000000:01000000:0.0:1788390530.113046:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390530.113052:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fa27ae800 from 1 10000000:01000000:0.0:1788390530.113054:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788390530.113077:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be9878e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390530.113085:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be9878e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390530.113098:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be9878e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390530.113167:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098068224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390530.113196:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390530.113220:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390530.113342:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098068224 00000100:00100000:1.0:1788390530.113351:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098068224 00000100:00100000:1.0:1788390530.113386:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390530.113392:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17188:x1875263098068224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390530.113401:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390530.113412:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4400/0xe156d0713be98795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be9878e expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.113431:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4400/0xe156d0713be98795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be9878e expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.113441:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4400/0xe156d0713be98795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be9878e expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.113450:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4400, rc 0) 00000100:00100000:1.0:1788390530.113477:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17188:x1875263098068224:12345-0@lo:101:mount.lustre.0 Request processed in 85us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390530.113483:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390530.113558:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098068224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390530.113571:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be9878e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98795 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390530.113580:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be9878e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98795 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390530.113622:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098068352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390530.113645:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390530.113667:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390530.113868:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098068352 00000100:00100000:3.0:1788390530.113873:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098068352 00000100:00100000:3.0:1788390530.113902:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788390530.113909:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17188:x1875263098068352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390530.113995:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17188:x1875263098068352:12345-0@lo:501:mount.lustre.0 Request processed in 86us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390530.114001:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788390530.114024:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098068352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390530.114059:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098068480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390530.114093:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390530.114221:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390530.114501:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098068480 00000100:00100000:3.0:1788390530.114506:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098068480 00000100:00100000:3.0:1788390530.114546:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788390530.114553:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17188:x1875263098068480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390530.114626:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17188:x1875263098068480:12345-0@lo:503:mount.lustre.0 Request processed in 73us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390530.114632:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788390530.114925:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098068480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390530.115440:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17238:1875263098068608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390530.115481:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390530.115506:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098068608 00000100:00100000:0.0:1788390530.115511:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390530.115512:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098068608 00000100:00100000:3.0:1788390530.115536:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390530.115544:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17238:x1875263098068608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390530.115623:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17238:x1875263098068608:12345-0@lo:502:llog_process_th.0 Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390530.115630:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788390530.115651:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17238:1875263098068608:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788390530.115699:0:17238:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788390530.115713:0:17238:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff984fbac43370) 00000020:00000080:0.0:1788390530.115731:0:17238:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788390530.115817:0:17238:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fa27ae800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788390530.115821:0:17238:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fa27ae800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788390530.115823:0:17238:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fa27ae800 4 00010000:00080000:0.0:1788390530.115850:0:17238:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e88067000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.111@tcp at head 00010000:00010000:0.0:1788390530.117581:0:17238:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788390530.117757:0:17238:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788390530.117794:0:17238:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788390530.117807:0:17238:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe156d0713be987a3 00000100:00080000:0.0:1788390530.117816:0:17238:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390530.117822:0:17238:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff984e88067000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390530.117854:0:17238:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88b20a80 x1875263098068736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788390530.117880:0:17238:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788390530.119671:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17238:1875263098068864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390530.119754:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390530.119795:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390530.119850:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098068864 00000100:00100000:1.0:1788390530.119858:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098068864 00000100:00100000:1.0:1788390530.119948:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390530.119958:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17238:x1875263098068864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390530.120078:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17238:x1875263098068864:12345-0@lo:502:llog_process_th.0 Request processed in 120us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390530.120086:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788390530.120210:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17238:1875263098068864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390530.120250:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17238:1875263098068992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390530.120279:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390530.120310:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390530.120485:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098068992 00000100:00100000:1.0:1788390530.120490:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098068992 00000100:00100000:1.0:1788390530.120550:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390530.120557:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17238:x1875263098068992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390530.120628:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17238:x1875263098068992:12345-0@lo:502:llog_process_th.0 Request processed in 71us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390530.120634:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788390530.121309:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17238:1875263098068992:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788390530.121392:0:17238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788390530.123240:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788390530.123273:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788390530.123312:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be9878e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98795 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390530.123336:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a81600/0xe156d0713be9878e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98795 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788390530.123382:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788390530.123384:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390530.123385:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390530.123386:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390530.123387:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390530.123388:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390530.123390:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390530.123391:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390530.123393:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390530.123394:0:17188:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390530.123397:0:17188:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788390530.123399:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390530.123401:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390530.123402:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390530.123403:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390530.123404:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390530.123405:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390530.123407:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390530.123408:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390530.123408:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390530.123410:0:17188:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390530.123432:0:17188:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788390530.123450:0:17188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098069120:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390530.123512:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390530.123545:0:17188:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390530.123565:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098069120 00000100:00100000:0.0:1788390530.123571:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098069120 00000100:00100000:0.0:1788390530.123615:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390530.123624:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17188:x1875263098069120:12345-0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788390530.123630:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263098068736:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788390530.123655:0:17201:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1788390530.123665:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:0.0:1788390530.123667:0:17201:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788390530.124907:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098068736 00000100:00100000:3.0:1788390530.124917:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098068736 00000100:00100000:3.0:1788390530.124949:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390530.124956:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875263098068736:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788390530.125027:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875263098068736:12345-0@lo:38:llog_process_th.0 Request processed in 70us (1359us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788390530.125034:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390530.125102:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788390530.125109:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e88067000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788390530.125114:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788390530.125118:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263098068736:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788390530.127043:0:17201:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788390530.127054:0:17201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788390530.127096:0:17225:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788390530.127100:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788390530.127310:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.127342:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98772 expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.127351:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.127384:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be98772 expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.127397:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be98772 expref: 12 pid: 17202 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390530.127410:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098069248:0@lo:104: 00000100:00100000:1.0:1788390530.127462:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390530.127495:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390530.127634:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098069248 00000100:00100000:1.0:1788390530.127642:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098069248 00000100:00100000:1.0:1788390530.127689:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390530.127698:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098069248:12345-0@lo:104: 00010000:00010000:1.0:1788390530.127709:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.127754:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390530.127760:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098069248:12345-0@lo:104: Request processed in 64us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390530.127767:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390530.127887:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17188:x1875263098069120:12345-0@lo:253:mount.lustre.0 Request processed in 4263us (4374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390530.127895:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390530.127937:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098069248:0@lo:104: 00010000:00010000:1.0:1788390530.127951:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.127969:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390530.127975:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.127982:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390530.127986:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.127993:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390530.128001:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390530.128016:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390530.128043:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.128050:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390530.128071:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.128078:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be98772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98779 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.128093:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390530.128095:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390530.128097:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390530.128684:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3623:1875263098069376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390530.128718:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390530.128782:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098069376 00000100:00100000:1.0:1788390530.128855:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098069376 00010000:00010000:1.0:1788390530.128879:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98772 expref: 12 pid: 17202 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390530.128902:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390530.128909:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:3623:x1875263098069376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390530.128920:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390530.128926:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98772 expref: 12 pid: 17202 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.128936:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be98772 expref: 12 pid: 17202 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.128955:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cfc00/0xe156d0713be98779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be98772 expref: 12 pid: 17202 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.128968:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.128976:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788390530.128988:0:17194:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001888241s 00010000:00010000:1.0:1788390530.128993:0:17194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.129001:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.129008:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.129014:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.129020:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390530.129024:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.129031:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.129045:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.129059:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390530.129088:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:3623:x1875263098069376:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390530.129095:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788390530.129213:0:17225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.129221:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390530.129227:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d5600/0xe156d0713be987aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390530.129255:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3623:1875263098069376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390530.129367:0:17188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17188:1875263098069120:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788390530.129378:0:17188:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788390530.129381:0:17188:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390530.129383:0:17188:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390530.129384:0:17188:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390530.129385:0:17188:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390530.129386:0:17188:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390530.129388:0:17188:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390530.129389:0:17188:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390530.129391:0:17188:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390530.129392:0:17188:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390530.129394:0:17188:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788390530.129407:0:17188:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1788390530.145856:0:17188:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788390530.147414:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788390530.147456:0:17249:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788390530.147462:0:17249:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788390530.147973:0:17250:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788390530.149119:0:17250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788390530.151894:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:0.0:1788390530.152712:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788390530.152752:0:17188:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390530.153583:0:17250:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788390530.153646:0:17250:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1788390530.154280:0:17188:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788390530.154302:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788390530.154380:0:17188:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788390530.154925:0:17251:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff984e86bd4700 x1875263098069504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390530.154934:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 00000040:00080000:0.0:1788390530.156651:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788390530.157214:0:17188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788390530.157240:0:17188:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788390530.157803:0:17188:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1788390530.158282:0:17188:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788390530.159988:0:17188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788390530.162179:0:17188:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788390530.162214:0:17188:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4a7c1583988 00100000:10000000:0.0:1788390530.162222:0:17188:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788390530.163913:0:17188:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788390530.163930:0:17188:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788390530.163948:0:17188:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788390530.163968:0:17188:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788390530.168239:0:17188:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788390530.168474:0:17188:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788390530.963144:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390531.162643:0:17247:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390531.162653:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390531.166168:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788390531.166182:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788390531.217819:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 10000000:01000000:2.0:1788390531.603428:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788390531.603435:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984fa27ae800 from 7 10000000:01000000:2.0:1788390531.603440:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788390531.603504:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390531.603516:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390531.603528:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390531.603554:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098069632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390531.603628:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390531.603679:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87ee83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390531.603703:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098069632 00000100:00100000:2.0:1788390531.603709:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098069632 00000100:00100000:2.0:1788390531.603769:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390531.603779:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+11:17206:x1875263098069632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390531.603791:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390531.603804:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be987b1 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390531.603829:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be987b1 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390531.603838:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be987b1 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390531.603858:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba0000, rc 0) 00000100:00100000:2.0:1788390531.603897:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17206:x1875263098069632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390531.603904:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390531.603950:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098069632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390531.603964:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390531.603973:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390531.604017:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098069760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788390531.604045:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390531.604058:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87ee83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390531.604069:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098069760 00000100:00100000:2.0:1788390531.604072:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098069760 00000100:00100000:2.0:1788390531.604091:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390531.604096:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17206:x1875263098069760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788390531.604108:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788390531.604121:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788390531.604124:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788390531.604180:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17206:x1875263098069760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390531.604186:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390531.604210:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098069760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788390531.604247:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788390531.604252:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390531.604261:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390531.995458:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390532.177553:0:17247:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788390532.177562:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390532.177684:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788390532.177720:0:17247:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390532.177901:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:1.0:1788390532.241484:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 00000001:02000400:3.0:1788390532.977678:0:17493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788390533.011281:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390533.265495:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 00000020:00000004:0.0:1788390533.606017:0:17545:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390533.606180:0:17545:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788390534.034556:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788390534.194533:0:17595:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788390534.194737:0:17595:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788390534.289385:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788390535.059595:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390535.251505:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098069888:0@lo:400:kworker.0 00000100:00100000:2.0:1788390535.251587:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788390535.251795:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788390535.251801:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788390535.251805:0:36:0:(import.c:65:import_set_state_nolock()) ffff984e85f76800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390535.251811:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 350 00000100:00080000:1.0:1788390535.251817:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788390535.251823:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff984e85f76800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390535.251850:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e86bd7480 x1875263098070016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390535.251909:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098070016:0@lo:38:kworker.0 00000100:00100000:2.0:1788390535.251939:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788390535.251978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390535.251983:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390535.251986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390535.251989:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390535.251992:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788390535.251996:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788390535.251998:0:36:0:(import.c:65:import_set_state_nolock()) ffff984e88067000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390535.252005:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff984e88067000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390535.252021:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e86bd6d80 x1875263098070144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788390535.253936:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098069888 00000100:00100000:0.0:1788390535.253952:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098069888 00000100:00100000:0.0:1788390535.254009:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390535.254018:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:3624:x1875263098069888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390535.254098:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:3624:x1875263098069888:12345-0@lo:400:kworker.0 Request processed in 82us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390535.254107:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390535.254646:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263098070144:0@lo:38:kworker.0 00000100:00100000:2.0:1788390535.254685:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390535.254735:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098070016 00000100:00100000:2.0:1788390535.254801:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098070016 00000100:00100000:2.0:1788390535.254827:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390535.254833:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1875263098070016:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788390535.254852:0:17215:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788390535.254945:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098070144 00000100:00100000:0.0:1788390535.254949:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098070144 00000100:00100000:0.0:1788390535.254972:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390535.254976:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263098070144:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788390535.254993:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:0.0:1788390535.255038:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe156d0713be987bf 00000004:00100000:0.0:1788390535.255055:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788390535.255193:0:17211:0:(import.c:65:import_set_state_nolock()) ffff984e88064800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390535.255239:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875263098070144:12345-0@lo:38:kworker.0 Request processed in 261us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390535.255256:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390535.255656:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098069888:0@lo:400:kworker.0 00010000:00080000:3.0:1788390535.257570:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984e86bd6d80 x1875263098070144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788390535.257590:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788390535.257599:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788390535.257605:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788390535.257608:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e88067000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788390535.257619:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875263098070144:0@lo:38:kworker.0 00000100:00100000:2.0:1788390535.272362:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1875263098070016:12345-0@lo:38:kworker.0 Request processed in 17483us (20377us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788390535.272378:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788390535.274610:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e85f76800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390535.274620:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788390535.274625:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098070016:0@lo:38:kworker.0 00000100:00100000:2.0:1788390535.315388:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788390536.081427:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390536.339653:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788390537.110776:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390537.365598:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788390538.129562:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390538.385452:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 00000020:01000004:3.0:1788390538.574787:0:17941:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788390538.574790:0:17941:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788390538.574792:0:17941:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788390538.574911:0:17941:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984f85302000 00000020:01000004:3.0:1788390538.574927:0:17941:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788390538.574938:0:17941:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788390538.574950:0:17941:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff984fbaf83370) 00000020:00000080:3.0:1788390538.574965:0:17941:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788390538.624880:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788390538.625044:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788390538.627950:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788390538.628161:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788390538.628605:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788390538.628790:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788390538.629002:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788390538.629210:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788390538.629421:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788390538.629597:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788390538.629790:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788390538.629969:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788390538.630197:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788390538.630418:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788390538.630873:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788390538.631091:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788390538.631575:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788390538.631764:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788390538.631932:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788390538.632090:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788390538.632271:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788390538.632462:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788390538.632676:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788390538.632873:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788390538.633074:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788390538.633470:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788390538.633706:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788390538.634029:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788390538.634252:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788390538.635768:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788390538.636104:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788390538.636349:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788390538.636549:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788390538.636765:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788390538.637003:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788390538.637189:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788390538.637465:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788390538.637647:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788390538.638013:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788390538.638550:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788390538.638907:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788390538.639148:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788390538.639388:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788390538.639650:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788390538.639897:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788390538.640123:0:17941:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00080000:01000000:0.0:1788390538.641278:0:17941:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788390538.641635:0:17941:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788390538.641646:0:17941:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788390538.641658:0:17941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be987cd 00000020:01000004:0.0:1788390538.641665:0:17941:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788390538.641686:0:17941:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788390538.641690:0:17941:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788390538.641696:0:17941:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788390538.641735:0:17941:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788390538.641739:0:17941:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788390538.648980:0:17941:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788390538.649021:0:17941:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.111@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788390538.649025:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788390538.649027:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788390538.649028:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390538.649029:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390538.649031:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390538.649032:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390538.649033:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788390538.649035:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390538.649036:0:17941:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390538.649040:0:17941:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788390538.649042:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788390538.649043:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788390538.649044:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788390538.649045:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788390538.649046:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788390538.649047:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788390538.649048:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788390538.649049:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788390538.649050:0:17941:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788390538.649078:0:17941:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788390538.649096:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788390538.649164:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390538.649271:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1ab600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390538.653640:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098070272 00000100:00100000:0.0:1788390538.653655:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098070272 00000100:00100000:2.0:1788390538.653860:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788390538.653872:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17941:x1875263098070272:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788390538.653924:0:17202:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788390538.653927:0:17202:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788390538.653934:0:17202:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788390538.654386:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17941:x1875263098070272:12345-0@lo:253:mount.lustre.0 Request processed in 515us (5221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390538.654404:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788390538.654689:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070272:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788390538.654705:0:17941:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788390538.654765:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390538.654767:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788390538.654768:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390538.654770:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390538.654771:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390538.654772:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390538.654773:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788390538.654775:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390538.654777:0:17941:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788390538.654798:0:17941:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984f85302000 from lustre-MDT0001 10000000:01000000:3.0:1788390538.654827:0:17941:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788390538.654830:0:17941:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788390538.654836:0:17941:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984fbac0cd28 local copy 00010000:00010000:3.0:1788390538.654845:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390538.654949:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390538.654987:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.655068:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390538.655123:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098070400 00000100:00100000:2.0:1788390538.655128:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098070400 00000100:00100000:2.0:1788390538.655191:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788390538.655199:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17941:x1875263098070400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390538.655280:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17941:x1875263098070400:12345-0@lo:501:mount.lustre.0 Request processed in 82us (292us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390538.655288:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788390538.655367:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070400:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788390538.655380:0:17941:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788390538.655396:0:17941:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788390538.655401:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.655409:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390538.655432:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984f85302000 10000000:01000000:3.0:1788390538.655436:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788390538.655441:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff984fbac0cd28 10000000:01000000:3.0:1788390538.655443:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788390538.655448:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff984fbac0cd28 from 1 10000000:01000000:3.0:1788390538.655450:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788390538.655471:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cec00/0xe156d0713be987d4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.655478:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20cec00/0xe156d0713be987d4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.655487:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cec00/0xe156d0713be987d4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390538.655509:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390538.655535:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.655792:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390538.655843:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098070528 00000100:00100000:0.0:1788390538.655848:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098070528 00000100:00100000:0.0:1788390538.655873:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788390538.655880:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+12:17941:x1875263098070528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390538.655895:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390538.655909:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a80200/0xe156d0713be987db lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be987d4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.655929:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a80200/0xe156d0713be987db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be987d4 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.655939:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a80200/0xe156d0713be987db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be987d4 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.655959:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80200, rc 0) 00000100:00100000:0.0:1788390538.655997:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+13:17941:x1875263098070528:12345-0@lo:101:mount.lustre.0 Request processed in 118us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.656004:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390538.656084:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390538.656097:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cec00/0xe156d0713be987d4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987db expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.656105:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cec00/0xe156d0713be987d4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be987db expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390538.656119:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788390538.656140:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cec00/0xe156d0713be987d4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987db expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.656147:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cec00/0xe156d0713be987d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987db expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390538.656156:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff984f85302000 10000000:01000000:3.0:1788390538.656159:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788390538.656163:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff984f85302000 from 1 10000000:01000000:3.0:1788390538.656165:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788390538.656178:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be987e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.656185:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be987e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.656193:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be987e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390538.656211:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390538.656249:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.656262:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390538.656528:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098070656 00000100:00100000:0.0:1788390538.656533:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098070656 00000100:00100000:0.0:1788390538.656551:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390538.656557:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+13:17941:x1875263098070656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390538.656564:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390538.656572:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a81800/0xe156d0713be987e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be987e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.656584:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a81800/0xe156d0713be987e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be987e2 expref: 14 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.656592:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a81800/0xe156d0713be987e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be987e2 expref: 14 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.656598:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81800, rc 0) 00000100:00100000:0.0:1788390538.656638:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+14:17941:x1875263098070656:12345-0@lo:101:mount.lustre.0 Request processed in 80us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.656643:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390538.656726:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390538.656737:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be987e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987e9 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.656744:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be987e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be987e9 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390538.656754:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788390538.656767:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be987e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987e9 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.656775:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cf000/0xe156d0713be987e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987e9 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390538.656781:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788390538.656784:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390538.656788:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff984f85302000 10000000:01000000:3.0:1788390538.656792:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788390538.656795:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788390538.656797:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788390538.656810:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cee00/0xe156d0713be987f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.656818:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20cee00/0xe156d0713be987f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.656831:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cee00/0xe156d0713be987f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390538.656844:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390538.656868:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.656885:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390538.656998:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098070784 00000100:00100000:0.0:1788390538.657002:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098070784 00000100:00100000:0.0:1788390538.657018:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390538.657023:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+14:17941:x1875263098070784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390538.657029:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390538.657036:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a80e00/0xe156d0713be987f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be987f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.657048:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a80e00/0xe156d0713be987f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be987f0 expref: 15 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.657056:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a80e00/0xe156d0713be987f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be987f0 expref: 15 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.657062:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80e00, rc 0) 00000100:00100000:0.0:1788390538.657096:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098070784:12345-0@lo:101:mount.lustre.0 Request processed in 73us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.657102:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788390538.657246:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390538.657256:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cee00/0xe156d0713be987f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987f7 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.657263:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cee00/0xe156d0713be987f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be987f7 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390538.658417:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788390538.659091:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390538.662521:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788390538.662564:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788390538.662574:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788390538.662587:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788390538.662599:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788390538.662611:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788390538.662624:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788390538.662638:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788390538.662651:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788390538.662667:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788390538.662682:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788390538.662697:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788390538.662722:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788390538.662738:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788390538.662752:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788390538.662759:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788390538.662766:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788390538.662772:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788390538.662779:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788390538.662787:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788390538.662794:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788390538.662801:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788390538.662807:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788390538.662824:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788390538.662827:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788390538.662920:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390538.662974:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.663012:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390538.663106:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098070912 00000100:00100000:1.0:1788390538.663112:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098070912 00000100:00100000:1.0:1788390538.663152:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788390538.663159:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098070912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390538.663281:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098070912:12345-0@lo:501:mount.lustre.0 Request processed in 122us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390538.663286:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788390538.663395:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098070912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390538.663423:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098071040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390538.663455:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.663475:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390538.663510:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098071040 00000100:00100000:2.0:1788390538.663513:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098071040 00000100:00100000:2.0:1788390538.663529:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788390538.663533:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098071040:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788390538.664026:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098071040:12345-0@lo:503:mount.lustre.0 Request processed in 490us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390538.664032:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390538.664094:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098071040:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390538.664434:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390538.664482:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098071168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390538.664509:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.664523:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390538.664563:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098071168 00000100:00100000:2.0:1788390538.664567:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098071168 00000100:00100000:2.0:1788390538.664606:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788390538.664614:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098071168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390538.665335:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098071168:12345-0@lo:502:mount.lustre.0 Request processed in 708us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390538.665341:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788390538.665421:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098071168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390538.665537:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788390538.665554:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788390538.665563:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788390538.665579:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788390538.665592:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788390538.665603:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788390538.665615:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788390538.665628:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788390538.665641:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788390538.665655:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788390538.665668:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788390538.665680:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788390538.665693:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788390538.665705:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788390538.665823:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788390538.665837:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788390538.665850:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788390538.665864:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788390538.665875:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788390538.665887:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788390538.665900:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788390538.665911:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788390538.665922:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788390538.665934:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788390538.665948:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788390538.665960:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788390538.665973:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788390538.666001:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788390538.666016:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788390538.666030:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788390538.666039:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788390538.666046:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788390538.666053:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788390538.666059:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788390538.666066:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788390538.666072:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788390538.666087:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788390538.666094:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788390538.666101:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788390538.666107:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788390538.666114:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788390538.666120:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788390538.666127:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788390538.666142:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788390538.666162:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098071296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390538.666193:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.666264:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb069b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390538.666291:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098071296 00000100:00100000:1.0:1788390538.666296:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098071296 00000100:00100000:1.0:1788390538.666371:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788390538.666379:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098071296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390538.666496:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098071296:12345-0@lo:502:mount.lustre.0 Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390538.666500:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788390538.666541:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098071296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788390538.666572:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788390538.666578:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788390538.667090:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390538.667098:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.667100:0:17945:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788390538.667103:0:17945:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788390538.667104:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390538.667115:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff984fb7b80000) 00000020:00000080:3.0:1788390538.667128:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788390538.667131:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788390538.667192:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788390538.667197:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be98805 00000020:00000080:3.0:1788390538.667424:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788390538.667429:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390538.667433:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.667434:0:17945:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788390538.667437:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390538.667440:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.667441:0:17945:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788390538.667445:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390538.667452:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff984fb7b84d28) 00000020:00000080:3.0:1788390538.667463:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788390538.667466:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788390538.667472:0:17945:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788390538.667474:0:17945:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788390538.667478:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788390538.667507:0:17945:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984f85302000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788390538.667515:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff984fb7b819b8) 00000020:00000080:3.0:1788390538.667521:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788390538.667564:0:17945:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788390538.667567:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be9881a 00000020:00000080:3.0:1788390538.667655:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788390538.667661:0:17945:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788390538.667665:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe156d0713be98821 00080000:01000000:3.0:1788390538.667670:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788390538.667673:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be98828 00010000:00010000:3.0:1788390538.714014:0:17945:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788390538.714766:0:17945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788390538.715460:0:17945:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788390538.716282:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788390538.716293:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390538.716298:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.716300:0:17945:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788390538.716303:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390538.716309:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.716310:0:17945:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788390538.716313:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788390538.716318:0:17945:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:00000080:3.0:1788390538.716369:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390538.716381:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff984fb7b83370) 00000020:00000080:3.0:1788390538.716396:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788390538.716399:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788390538.716459:0:17945:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788390538.716464:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788390538.716469:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be98836 00010000:00080000:3.0:1788390538.716496:0:17945:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984fb767e800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.111@tcp at head 00010000:00010000:3.0:1788390538.717913:0:17945:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788390538.722156:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788390538.722172:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788390538.722224:0:17945:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788390538.722249:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be9883d 00000100:00080000:3.0:1788390538.722259:0:17945:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390538.722265:0:17945:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff984fb767e800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390538.722303:0:17945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adc000 x1875263098071424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390538.722413:0:17945:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788390538.722523:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098071424:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788390538.722528:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390538.722532:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.722534:0:17945:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788390538.722537:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788390538.722539:0:17945:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788390538.722541:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390538.722542:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390538.722544:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788390538.722546:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.722547:0:17945:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788390538.722549:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390538.722553:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.722554:0:17945:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788390538.722557:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788390538.722588:0:17945:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788390538.722599:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390538.722602:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.722603:0:17945:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788390538.722605:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788390538.722607:0:17945:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788390538.722608:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390538.722620:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390538.722621:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788390538.722624:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.722625:0:17945:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788390538.722627:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390538.722630:0:17945:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788390538.722634:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.722635:0:17945:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788390538.722638:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788390538.722641:0:17945:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000100:00100000:0.0:1788390538.722644:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788390538.722673:0:17945:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788390538.722675:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390538.722699:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff984f9c6dcd28) 00000100:00100000:0.0:1788390538.722700:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098071424 00000100:00100000:0.0:1788390538.722706:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098071424 00000020:00000080:3.0:1788390538.722711:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788390538.722716:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788390538.722735:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390538.722742:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1875263098071424:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788390538.722764:0:17214:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 359 last 0 00000004:00080000:3.0:1788390538.722792:0:17945:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788390538.722798:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788390538.722800:0:17214:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be9884b 00000020:00000080:3.0:1788390538.722804:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be98852 00000004:00100000:0.0:1788390538.722815:0:17214:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788390538.722820:0:17214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:3.0:1788390538.722858:0:17945:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984fc18fa800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.111@tcp at head 00010000:00010000:3.0:1788390538.723068:0:17945:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1788390538.723993:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788390538.724001:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788390538.724004:0:36:0:(import.c:65:import_set_state_nolock()) ffff984e85f76800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390538.724010:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 355 00000100:00080000:1.0:1788390538.724016:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788390538.724030:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff984e85f76800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390538.724056:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e86bd4380 x1875263098071552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390538.724074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390538.724078:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390538.724081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390538.724084:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788390538.724121:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390538.724135:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098071680:0@lo:400:kworker.0 00000100:00100000:1.0:1788390538.724193:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390538.724262:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098071552:0@lo:38:kworker.0 00000100:00100000:0.0:1788390538.724301:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390538.724350:0:17215:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788390538.724357:0:17215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788390538.724647:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098071552 00000100:00100000:1.0:1788390538.724654:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098071552 00000100:00100000:0.0:1788390538.724797:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390538.724804:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1875263098071552:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788390538.724856:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1875263098071552:12345-0@lo:38:kworker.0 Request processed in 51us (554us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788390538.724864:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390538.724936:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390538.724944:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e85f76800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390538.724948:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788390538.724952:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098071552:0@lo:38:kworker.0 00000100:00100000:3.0:1788390538.725124:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098071680 00000100:00100000:3.0:1788390538.725129:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098071680 00000100:00100000:3.0:1788390538.725165:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390538.725171:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098071680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390538.725230:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098071680:12345-0@lo:400:kworker.0 Request processed in 59us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390538.725236:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788390538.725257:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984e86bd7b80 x1875263098071680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390538.725269:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098071680:0@lo:400:kworker.0 00000040:01000000:0.0:1788390538.726166:0:17945:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788390538.731153:0:17945:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788390538.732762:0:17214:0:(import.c:65:import_set_state_nolock()) ffff984fb78a3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390538.732863:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1875263098071424:12345-0@lo:38:llog_process_th.0 Request processed in 10118us (10216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390538.732881:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390538.732902:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390538.732913:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788390538.732922:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788390538.732928:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788390538.732931:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fb767e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788390538.732949:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098071424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788390538.733145:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098071808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788390538.733188:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390538.733266:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098071808 00000100:00100000:0.0:1788390538.733275:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098071808 00000100:00100000:0.0:1788390538.733352:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390538.733362:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875263098071808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788390538.733386:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788390538.733431:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875263098071808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390538.733499:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098071808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788390538.733844:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1788390538.734388:0:17945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390538.734625:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788390538.734742:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1788390538.735398:0:17951:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390538.735407:0:17951:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788390538.738428:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788390538.738443:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788390538.738488:0:17945:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788390538.738510:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be98859 00000100:00080000:3.0:1788390538.738520:0:17945:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390538.738526:0:17945:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff984fc18fa800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390538.738562:0:17945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88addf80 x1875263098071936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390538.738585:0:17945:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788390538.738645:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390538.738650:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.738653:0:17945:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788390538.738657:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788390538.738659:0:17945:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788390538.738661:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390538.738663:0:17945:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390538.738665:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788390538.738668:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1788390538.738669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:3.0:1788390538.738671:0:17945:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788390538.738674:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390538.738678:0:17945:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000100:00080000:1.0:1788390538.738686:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1788390538.738687:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.738691:0:17945:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000100:00080000:1.0:1788390538.738691:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:3.0:1788390538.738698:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000100:00080000:1.0:1788390538.738698:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1788390538.738705:0:17945:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.111@tcp to nid 0x20000c0a8ca6f (192.168.202.111@tcp) 00000020:01000000:3.0:1788390538.738742:0:17945:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788390538.738745:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390538.738768:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff984f9c6d8000) 00000020:00000080:3.0:1788390538.738781:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788390538.738786:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788390538.738848:0:17945:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788390538.738855:0:17945:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788390538.738860:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe156d0713be98867 00010000:00080000:3.0:1788390538.738887:0:17945:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984fc18fe800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.111@tcp at head 00010000:00010000:3.0:1788390538.739094:0:17945:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788390538.739161:0:17945:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788390538.739174:0:17945:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788390538.740739:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098071936:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788390538.740809:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263098071936 offset 0 length 520: 4 00000040:00080000:3.0:1788390538.744819:0:17945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390538.745305:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788390538.745566:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788390538.746134:0:17953:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788390538.746139:0:17953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788390538.747235:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788390538.747248:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788390538.747287:0:17945:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788390538.747307:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be9886e 00000100:00080000:3.0:1788390538.747316:0:17945:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390538.747340:0:17945:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff984fc18fe800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390538.747375:0:17945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adc000 x1875263098072064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788390538.747435:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098072064:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788390538.747487:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263098072064 offset 0 length 520: 4 00000100:00080000:3.0:1788390538.747542:0:17945:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788390538.747612:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390538.747617:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.747619:0:17945:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788390538.747622:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390538.747625:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.747627:0:17945:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788390538.747630:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390538.747631:0:17945:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788390538.747634:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390538.747636:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.747637:0:17945:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788390538.747639:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390538.747648:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.747649:0:17945:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788390538.747653:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788390538.747677:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390538.747680:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390538.747682:0:17945:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788390538.747685:0:17945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1788390538.747764:0:17941:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788390538.747794:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788390538.747810:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cee00/0xe156d0713be987f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987f7 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.747821:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cee00/0xe156d0713be987f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be987f7 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390538.747829:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984f85302000 from 1 10000000:01000000:3.0:1788390538.747832:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390538.747855:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.747863:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.747874:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390538.747888:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390538.747926:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.747951:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390538.747973:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098072192 00000100:00100000:3.0:1788390538.747979:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098072192 00000100:00100000:3.0:1788390538.748026:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390538.748035:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+15:17941:x1875263098072192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390538.748048:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390538.748058:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98875 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.748088:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98875 expref: 16 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.748098:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98875 expref: 16 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.748106:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfe00, rc 0) 00000100:00100000:3.0:1788390538.748150:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+16:17941:x1875263098072192:12345-0@lo:101:mount.lustre.0 Request processed in 116us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390538.748156:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390538.748200:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390538.748222:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.748231:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390538.748765:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072320:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788390538.748801:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.748814:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390538.749252:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098072320 00000100:00100000:1.0:1788390538.749259:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098072320 00000100:00100000:1.0:1788390538.749301:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788390538.749308:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+16:17941:x1875263098072320:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788390538.749352:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788390538.749369:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788390538.749372:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788390538.749452:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+16:17941:x1875263098072320:12345-0@lo:256:mount.lustre.0 Request processed in 144us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390538.749460:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788390538.749493:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390538.749499:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390538.749502:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390538.749504:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788390538.749618:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072320:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788390538.750199:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788390538.750223:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.750233:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390538.750240:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984f85302000 from 1 10000000:01000000:2.0:1788390538.750243:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390538.750268:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.750276:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.750285:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390538.750301:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788390538.750363:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390538.750387:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b92a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390538.750687:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098072448 00000100:00100000:3.0:1788390538.750693:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098072448 00000100:00100000:3.0:1788390538.750875:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788390538.750883:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+16:17941:x1875263098072448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390538.750893:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390538.750904:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98883 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.750923:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98883 expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.750932:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98883 expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.750941:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf600, rc 0) 00000100:00100000:3.0:1788390538.750981:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098072448:12345-0@lo:101:mount.lustre.0 Request processed in 98us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390538.750988:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788390538.751103:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390538.751173:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.751188:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390538.751314:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390538.751389:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390538.751414:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390538.751437:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982c5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788390538.751517:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098072576 00000100:00100000:3.0:1788390538.751521:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098072576 00000100:00100000:3.0:1788390538.751552:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390538.751560:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098072576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390538.751636:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098072576:12345-0@lo:501:mount.lustre.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390538.751643:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390538.751674:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390538.751701:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390538.751865:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.751923:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f89593b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390538.752063:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098072704 00000100:00100000:1.0:1788390538.752068:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098072704 00000100:00100000:1.0:1788390538.752099:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788390538.752202:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098072704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390538.752307:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098072704:12345-0@lo:503:mount.lustre.0 Request processed in 200us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390538.752313:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390538.752440:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072704:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390538.752898:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390538.752962:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390538.752999:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.753015:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f89593b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390538.753030:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098072832 00000100:00100000:3.0:1788390538.753034:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098072832 00000100:00100000:3.0:1788390538.753069:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390538.753076:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098072832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390538.753229:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098072832:12345-0@lo:502:mount.lustre.0 Request processed in 153us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390538.753236:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390538.753274:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390538.753464:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788390538.753489:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788390538.753505:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788390538.753520:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788390538.753536:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788390538.753552:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788390538.753567:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788390538.753581:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788390538.753595:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788390538.753609:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788390538.753625:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788390538.753647:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390538.753680:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.753695:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f89593b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390538.753868:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098072960 00000100:00100000:1.0:1788390538.753873:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098072960 00000100:00100000:1.0:1788390538.753895:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788390538.753902:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098072960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390538.753968:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098072960:12345-0@lo:502:mount.lustre.0 Request processed in 67us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390538.753975:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390538.754235:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098072960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390538.754278:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788390538.754287:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788390538.755015:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390538.755025:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390538.755028:0:17955:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788390538.755035:0:17955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984f85302000 00000020:00000080:0.0:1788390538.755038:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788390538.755046:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390538.755048:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390538.755050:0:17955:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788390538.755052:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390538.755054:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390538.755056:0:17955:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788390538.755059:0:17955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984f85302000 00000020:00000080:0.0:1788390538.755062:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788390538.755226:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390538.755231:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390538.755232:0:17955:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788390538.755235:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390538.755237:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390538.755239:0:17955:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788390538.755242:0:17955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984f85302000 00000020:00000080:0.0:1788390538.755245:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788390538.760640:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390538.760657:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390538.760659:0:17955:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788390538.760664:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390538.760668:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390538.760669:0:17955:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788390538.760674:0:17955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984f85302000 00000020:00000080:0.0:1788390538.760676:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788390538.760866:0:17955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390538.760870:0:17955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390538.760872:0:17955:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788390538.760875:0:17955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788390538.761921:0:17941:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788390538.761963:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390538.761985:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.762000:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390538.762051:0:17941:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788390538.762054:0:17941:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984f85302000 10000000:01000000:0.0:1788390538.762057:0:17941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984f85302000 10000000:01000000:0.0:1788390538.762061:0:17941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390538.762067:0:17941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984f85302000 from 1 10000000:01000000:0.0:1788390538.762070:0:17941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788390538.762106:0:17941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80a00/0xe156d0713be98891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.762114:0:17941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a80a00/0xe156d0713be98891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.762126:0:17941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a80a00/0xe156d0713be98891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390538.762155:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390538.762228:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390538.762265:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef45d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390538.762346:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098073088 00000100:00100000:1.0:1788390538.762354:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098073088 00000100:00100000:1.0:1788390538.762396:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788390538.762405:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17941:x1875263098073088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390538.762419:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390538.762431:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4e00/0xe156d0713be98898 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98891 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390538.762455:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4e00/0xe156d0713be98898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98891 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390538.762465:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4e00/0xe156d0713be98898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98891 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390538.762474:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4e00, rc 0) 00000100:00100000:1.0:1788390538.762516:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073088:12345-0@lo:101:mount.lustre.0 Request processed in 111us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390538.762523:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788390538.762993:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390538.763007:0:17941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a80a00/0xe156d0713be98891 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98898 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.763016:0:17941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a80a00/0xe156d0713be98891 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98898 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390538.767887:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788390538.768151:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390538.768403:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788390538.768425:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788390538.768438:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788390538.768452:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788390538.768463:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788390538.768474:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788390538.768486:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788390538.768498:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788390538.768511:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788390538.768524:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788390538.768536:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788390538.768549:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788390538.768560:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788390538.768574:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788390538.768587:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788390538.768614:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788390538.768629:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788390538.768652:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788390538.768666:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788390538.768677:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788390538.768690:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788390538.768702:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788390538.768853:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788390538.768871:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788390538.768885:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788390538.768899:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788390538.768913:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788390538.768927:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788390538.768947:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788390538.768953:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788390538.769036:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390538.769099:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390538.769139:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390538.769318:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098073216 00000100:00100000:3.0:1788390538.769348:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098073216 00000100:00100000:3.0:1788390538.769398:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788390538.769408:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390538.769516:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073216:12345-0@lo:501:mount.lustre.0 Request processed in 109us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390538.769523:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788390538.770467:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390538.770510:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390538.770555:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390538.770582:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390538.770598:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098073344 00000100:00100000:0.0:1788390538.770603:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098073344 00000100:00100000:0.0:1788390538.770643:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788390538.770651:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073344:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390538.770848:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073344:12345-0@lo:503:mount.lustre.0 Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.770857:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788390538.770902:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788390538.771293:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788390538.771898:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390538.771943:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390538.771971:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef45d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390538.771992:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098073472 00000100:00100000:0.0:1788390538.771998:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098073472 00000100:00100000:0.0:1788390538.772069:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390538.772077:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390538.772158:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073472:12345-0@lo:502:mount.lustre.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.772165:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788390538.775551:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788390538.775989:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788390538.776021:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788390538.776036:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788390538.776049:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788390538.776062:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788390538.776075:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788390538.776088:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788390538.776100:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788390538.776201:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788390538.776230:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788390538.776247:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788390538.776260:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788390538.776272:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788390538.776284:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788390538.776297:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788390538.776309:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788390538.776345:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788390538.776361:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788390538.776375:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788390538.776387:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788390538.776399:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788390538.776421:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788390538.776434:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788390538.776447:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788390538.776471:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788390538.776486:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788390538.776498:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788390538.776511:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788390538.776523:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788390538.776536:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788390538.776548:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788390538.776562:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788390538.776574:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788390538.776587:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788390538.776599:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788390538.776610:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788390538.776623:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788390538.776636:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788390538.776649:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788390538.776662:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788390538.776687:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788390538.776701:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788390538.776714:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788390538.776727:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788390538.776739:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788390538.776750:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788390538.776763:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788390538.776835:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788390538.777014:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390538.777087:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390538.777198:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390538.778377:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098073600 00000100:00100000:0.0:1788390538.778387:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098073600 00000100:00100000:0.0:1788390538.778441:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788390538.778451:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390538.778593:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073600:12345-0@lo:502:mount.lustre.0 Request processed in 143us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.778601:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788390538.778665:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390538.779164:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1788390538.779191:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1788390538.779237:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390538.779280:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390538.779308:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef45900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390538.779501:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098073728 00000100:00100000:0.0:1788390538.779506:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098073728 00000100:00100000:0.0:1788390538.779541:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390538.779548:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390538.779622:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073728:12345-0@lo:502:mount.lustre.0 Request processed in 74us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.779629:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390538.779670:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390538.779705:0:17941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1788390538.779724:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788390538.780826:0:17961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788390538.780840:0:17961:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff984fbac44d28) 00000020:00000080:0.0:1788390538.780860:0:17961:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788390538.780947:0:17961:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984f85302000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788390538.780950:0:17961:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984f85302000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788390538.780952:0:17961:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984f85302000 3 00010000:00080000:0.0:1788390538.780976:0:17961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984fc19aa800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.111@tcp at head 00010000:00010000:1.0:1788390538.783014:0:17961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788390538.783228:0:17961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788390538.783270:0:17961:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788390538.783287:0:17961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe156d0713be988a6 00000100:00080000:1.0:1788390538.783298:0:17961:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390538.783304:0:17961:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff984fc19aa800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390538.783362:0:17961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e86bd4380 x1875263098073856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390538.783393:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875263098073856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788390538.783470:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788390538.783520:0:17961:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788390538.783539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390538.783544:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390538.783546:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390538.783548:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788390538.783851:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098073856 00000100:00100000:0.0:1788390538.783858:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098073856 00000100:00100000:0.0:1788390538.783892:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390538.783900:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3621:x1875263098073856:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788390538.783921:0:17209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:0.0:1788390538.783960:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe156d0713be988ad 00000004:00100000:0.0:1788390538.783976:0:17209:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788390538.784009:0:17209:0:(import.c:65:import_set_state_nolock()) ffff984fc19ab000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390538.784065:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875263098073856:12345-0@lo:38:llog_process_th.0 Request processed in 165us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.784072:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788390538.784113:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984e86bd4380 x1875263098073856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390538.784128:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390538.784136:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788390538.784143:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788390538.784148:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788390538.784150:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc19aa800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788390538.784159:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875263098073856:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788390538.786050:0:17961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1788390538.786167:0:17941:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788390538.786196:0:17941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788390538.786366:0:17941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80a00/0xe156d0713be98891 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98898 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.786378:0:17941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a80a00/0xe156d0713be98891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98898 expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788390538.786430:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788390538.786433:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788390538.786434:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390538.786436:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390538.786437:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390538.786439:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390538.786440:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390538.786442:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390538.786444:0:17941:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390538.786447:0:17941:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788390538.786449:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390538.786451:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788390538.786452:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390538.786453:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390538.786454:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390538.786455:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390538.786456:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390538.786460:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390538.786461:0:17941:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390538.786487:0:17941:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788390538.786505:0:17941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073984:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390538.786565:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390538.786596:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098073984 00000100:00100000:0.0:1788390538.786601:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098073984 00000100:00100000:0.0:1788390538.786634:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390538.786641:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17941:x1875263098073984:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788390538.786673:0:17201:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788390538.786685:0:17201:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788390538.786883:0:17941:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef45a80 going to sleep for 11 seconds 00000001:00100000:0.0:1788390538.790577:0:17189:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788390538.790989:0:17201:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788390538.791005:0:17201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788390538.791084:0:17225:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788390538.791088:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788390538.791108:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.791127:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be987b1 expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.791134:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98875 expref: 18 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.791140:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.791175:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be98875 expref: 18 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.791188:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be98875 expref: 18 pid: 17202 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390538.791231:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b23100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098074112:0@lo:104: 00000100:00100000:0.0:1788390538.791296:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.791374:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098074112 00010000:00010000:0.0:1788390538.791377:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be987b1 expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390538.791381:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098074112 00010000:00010000:0.0:1788390538.791385:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be987b1 expref: 18 pid: 17204 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390538.791393:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098074240:0@lo:104: 00000100:00100000:0.0:1788390538.791413:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.791418:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098074240 00000100:00100000:3.0:1788390538.791420:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098074240 00000100:00100000:0.0:1788390538.791423:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef45f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390538.791436:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390538.791445:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:17225:x1875263098074112:12345-0@lo:104: 00010000:00010000:3.0:1788390538.791457:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.791562:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390538.791569:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:17225:x1875263098074112:12345-0@lo:104: Request processed in 125us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390538.791576:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390538.791592:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390538.791598:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098074240:12345-0@lo:104: 00010000:00010000:3.0:1788390538.791605:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.791638:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788390538.791649:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098074240:12345-0@lo:104: Request processed in 51us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390538.791655:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788390538.791671:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390538.791671:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390538.791678:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.791690:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390538.791695:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.791703:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390538.791709:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390538.791715:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788390538.791741:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.791759:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390538.791777:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.791783:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98875 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9887c expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.791788:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390538.791793:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.791793:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390538.791795:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390538.791797:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390538.791800:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0600 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390538.791803:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390538.791803:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788390538.791809:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390538.791812:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098074368:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1788390538.791816:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390538.791821:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788390538.791835:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390538.791839:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390538.791841:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390538.791876:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.791883:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e87ba0600/0xe156d0713be987b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be987b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.791894:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390538.791895:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390538.791903:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390538.791914:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098074496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390538.791937:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.791980:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098074368 00000100:00100000:3.0:1788390538.791984:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098074368 00000100:00100000:1.0:1788390538.791991:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098074496 00000100:00100000:1.0:1788390538.791994:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098074496 00010000:00010000:3.0:1788390538.791999:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98875 expref: 20 pid: 17202 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390538.792006:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be987b1 expref: 20 pid: 17204 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390538.792018:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390538.792024:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:3622:x1875263098074368:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390538.792025:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390538.792030:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:3624:x1875263098074496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390538.792033:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390538.792035:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390538.792038:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98875 expref: 20 pid: 17202 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390538.792039:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be987b1 expref: 20 pid: 17204 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390538.792048:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be987b1 expref: 20 pid: 17204 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390538.792416:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:17941:x1875263098073984:12345-0@lo:253:mount.lustre.0 Request processed in 5774us (5849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390538.792432:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390538.793346:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b23100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098074112:0@lo:104: 00000100:00100000:0.0:1788390538.793983:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098074240:0@lo:104: 00010000:00010000:3.0:1788390538.795117:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be98875 expref: 19 pid: 17202 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390538.795151:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e87ba0000/0xe156d0713be987b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be987b1 expref: 19 pid: 17204 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390538.795169:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390538.795246:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:3624:x1875263098074496:12345-0@lo:103:ldlm_bl.0 Request processed in 3214us (3306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390538.795254:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390538.795361:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098074496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390538.795441:0:17941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17941:1875263098073984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788390538.795451:0:17941:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788390538.795454:0:17941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788390538.795456:0:17941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788390538.795458:0:17941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390538.795459:0:17941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390538.795460:0:17941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390538.795461:0:17941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390538.795463:0:17941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788390538.795464:0:17941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390538.795465:0:17941:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788390538.795473:0:17941:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788390538.796337:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cfe00/0xe156d0713be9887c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be98875 expref: 17 pid: 17202 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.796355:0:17195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.796365:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390538.796380:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390538.796384:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788390538.796385:0:17195:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005297155s 00010000:00010000:3.0:1788390538.796390:0:17195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.796397:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.796417:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.796423:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.796429:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390538.796433:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.796442:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.796451:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390538.796463:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390538.796525:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+16:3622:x1875263098074368:12345-0@lo:103:ldlm_bl.0 Request processed in 4500us (4684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390538.796533:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390538.796547:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098074368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390538.796594:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.796604:0:17225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.796610:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390538.796617:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a81400/0xe156d0713be988b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788390538.800677:0:17967:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000040:01000000:0.0:1788390538.800679:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788390538.800682:0:17967:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788390538.800989:0:17968:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788390538.801001:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788390538.801471:0:17968:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390538.801503:0:17969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875263098074624:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788390538.801565:0:17969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390538.801595:0:17969:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390538.801644:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098074624 00000100:00100000:1.0:1788390538.801651:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098074624 00000100:00100000:1.0:1788390538.801729:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390538.801739:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875263098074624:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788390538.801813:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875263098074624:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390538.801820:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:01000000:1.0:1788390538.802046:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788390538.802081:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390538.802396:0:17969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875263098074624:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788390538.802421:0:17969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788390538.802446:0:17969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875263098074752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788390538.802475:0:17969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390538.802495:0:17969:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6017c00 going to sleep for 11 seconds 00000004:00000080:1.0:1788390538.803227:0:17941:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788390538.803237:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788390538.803281:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390538.804979:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788390538.805095:0:17968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788390538.805138:0:17968:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788390538.805173:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098074752 00000100:00100000:0.0:1788390538.805181:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098074752 00000100:00100000:0.0:1788390538.805235:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390538.805245:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17969:x1875263098074752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788390538.805428:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17969:x1875263098074752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 184us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.805436:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1788390538.805584:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:3.0:1788390538.805587:0:17969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875263098074752:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788390538.805612:0:17941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1788390538.805666:0:17969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17969:1875263098074880:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788390538.805704:0:17969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.805762:0:17969:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87811cc0 going to sleep for 11 seconds 00000040:00080000:1.0:1788390538.805927:0:17941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788390538.805977:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098074880 00000100:00100000:0.0:1788390538.805981:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098074880 00000100:00100000:0.0:1788390538.806006:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390538.806012:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17969:x1875263098074880:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788390538.806084:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17969:x1875263098074880:12345-0@lo:900:lod0001_rec0000.0 Request processed in 71us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.806089:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788390538.806150:0:17969:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984e88adc380 x1875263098074880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788390554 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390538.806161:0:17969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17969:1875263098074880:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788390538.806224:0:17969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875263098075008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788390538.806251:0:17969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390538.806304:0:17969:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f87811f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390538.806367:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098075008 00000100:00100000:0.0:1788390538.806371:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098075008 00000100:00100000:0.0:1788390538.806401:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390538.806408:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875263098075008:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788390538.806505:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875263098075008:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390538.806512:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00080000:10000000:1.0:1788390538.806546:0:17941:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:3.0:1788390538.806547:0:17969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875263098075008:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788390538.806583:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:1.0:1788390538.807998:0:17941:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:3.0:1788390538.809467:0:17969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788390538.809538:0:17969:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788390538.809543:0:17969:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788390538.817108:0:17941:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788390538.817143:0:17941:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4a7c0d7f988 00100000:10000000:1.0:1788390538.817150:0:17941:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788390538.817485:0:17941:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788390538.817515:0:17941:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788390538.817547:0:17941:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788390538.817572:0:17941:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788390538.818375:0:17941:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390538.818578:0:17941:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788390539.156580:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390539.409674:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 00000040:00080000:0.0:1788390539.795173:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788390540.177507:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390540.434378:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 0 seconds 10000000:01000000:1.0:1788390540.504360:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788390540.504368:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984f85302000 from 8 10000000:01000000:1.0:1788390540.504373:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788390540.504421:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390540.504434:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390540.504446:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390540.504471:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098075136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390540.504542:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390540.504597:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef46240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390540.504639:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098075136 00000100:00100000:1.0:1788390540.504646:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098075136 00000100:00100000:1.0:1788390540.504720:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390540.504731:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+16:17206:x1875263098075136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390540.504744:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390540.504756:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be988bb expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390540.504778:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be988bb expref: 17 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390540.504789:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be988bb expref: 17 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390540.504799:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5600, rc 0) 00000100:00100000:1.0:1788390540.504836:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098075136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390540.504843:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390540.504889:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098075136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390540.504902:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390540.504910:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390540.504952:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098075264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788390540.504981:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390540.505005:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef46240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390540.505050:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098075264 00000100:00100000:3.0:1788390540.505057:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098075264 00000100:00100000:1.0:1788390540.505186:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788390540.505208:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098075264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788390540.505231:0:17202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788390540.505247:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788390540.505250:0:17202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788390540.505376:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098075264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390540.505383:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788390540.505499:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098075264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788390540.505760:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788390540.505768:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390540.505778:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390540.505789:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788390540.505797:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984fa27ae800 from 8 10000000:01000000:2.0:1788390540.505870:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788390540.505893:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390540.505902:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390540.505910:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390540.505923:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098075392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390540.505949:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390540.505972:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1ab480 going to sleep for 11 seconds 00000100:00100000:1.0:1788390540.506022:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098075392 00000100:00100000:1.0:1788390540.506026:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098075392 00000100:00100000:1.0:1788390540.506060:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788390540.506068:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098075392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390540.506076:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390540.506086:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be988c9 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390540.506168:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be988c9 expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390540.506179:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be988c9 expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390540.506186:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4c00, rc 0) 00000100:00100000:1.0:1788390540.506306:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17206:x1875263098075392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390540.506313:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390540.506486:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098075392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390540.506499:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390540.506509:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390540.506638:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098075520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788390540.506671:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390540.506730:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390540.506758:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098075520 00000100:00100000:2.0:1788390540.506762:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098075520 00000100:00100000:2.0:1788390540.506888:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788390540.506896:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17206:x1875263098075520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788390540.506908:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788390540.506921:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788390540.506924:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788390540.507004:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17206:x1875263098075520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390540.507011:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788390540.507069:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098075520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788390540.507121:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390540.507127:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390540.507144:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390540.817381:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390530/real 1788390530] req@ffff984e88adea00 x1875263098067072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390540 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390540.817410:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e88adea00 x1875263098067072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390540 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390540.817420:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390530/real 1788390530] req@ffff984e883aed80 x1875263098066944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390540 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390540.817432:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e883aed80 x1875263098066944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390540 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788390540.817451:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e877d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390540.817470:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788390540.817473:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098067072:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788390540.817479:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f8a4f1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390540.817483:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788390540.817486:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098066944:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788390540.817525:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788390540.817529:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788390540.817533:0:36:0:(import.c:65:import_set_state_nolock()) ffff984e85f76800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390540.817540:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff984e85f76800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390540.817574:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adea00 x1875263098075648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390540.817597:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390540.817600:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788390540.817602:0:36:0:(import.c:65:import_set_state_nolock()) ffff984f8a4f1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390540.817605:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 350 00000100:00080000:3.0:1788390540.817610:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788390540.817613:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff984f8a4f1800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390540.817625:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adc380 x1875263098075776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390540.817633:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390540.817636:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788390540.817637:0:36:0:(import.c:65:import_set_state_nolock()) ffff984e877d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390540.817640:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 350 00000100:00080000:3.0:1788390540.817642:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788390540.817645:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984e877d0800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390540.817653:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88ade680 x1875263098075904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390540.817701:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390540.817704:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788390540.817707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390540.817710:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788390540.817734:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263098076032:0@lo:400:kworker.0 00000100:00100000:3.0:1788390540.817795:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390540.817859:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098076160:0@lo:400:kworker.0 00000100:00100000:3.0:1788390540.817887:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390540.817905:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390540.817910:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098076288:0@lo:400:kworker.0 00000100:00100000:3.0:1788390540.817929:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390540.817964:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098076032 00000100:00100000:3.0:1788390540.817970:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098076032 00000100:00100000:3.0:1788390540.818017:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098076288 00000100:00100000:3.0:1788390540.818020:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098076288 00000100:00100000:3.0:1788390540.818032:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390540.818039:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263098076032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390540.818081:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875263098076032:12345-0@lo:400:kworker.0 Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390540.818087:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390540.818100:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390540.818105:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098076288:12345-0@lo:400:kworker.0 00000040:00080000:0.0:1788390540.818112:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788390540.818128:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098076288:12345-0@lo:400:kworker.0 Request processed in 24us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390540.818133:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390540.818151:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098076160 00000100:00100000:3.0:1788390540.818154:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098076160 00000100:00100000:3.0:1788390540.818186:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390540.818192:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098076160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390540.818232:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098076160:12345-0@lo:400:kworker.0 Request processed in 41us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390540.818238:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788390540.818268:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984e88add180 x1875263098076288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390540.818283:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098076288:0@lo:400:kworker.0 00000100:00100000:3.0:1788390540.818291:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098076160:0@lo:400:kworker.0 00010000:00080000:3.0:1788390540.818306:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984e88adc700 x1875263098076032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390540.818311:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875263098076032:0@lo:400:kworker.0 00000100:00100000:3.0:1788390540.818339:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098075648:0@lo:38:kworker.0 00000100:00100000:3.0:1788390540.818361:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390540.818381:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098075648 00000100:00100000:3.0:1788390540.818382:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098075776:0@lo:8:kworker.0 00000100:00100000:0.0:1788390540.818385:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098075648 00000400:00000100:3.0:1788390540.818401:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263098075776 offset 0 length 520: 4 00000100:00100000:0.0:1788390540.818403:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390540.818409:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3621:x1875263098075648:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788390540.818417:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098075904:0@lo:8:kworker.0 00010000:00080000:0.0:1788390540.818430:0:17214:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 361 last 0 00000400:00000100:3.0:1788390540.818433:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263098075904 offset 0 length 520: 4 00000020:00000080:0.0:1788390540.818461:0:17214:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be988d7 00000004:00100000:0.0:1788390540.818477:0:17214:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788390540.818483:0:17214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788390540.827254:0:17214:0:(import.c:65:import_set_state_nolock()) ffff984fc19a8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390540.827382:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875263098075648:12345-0@lo:38:kworker.0 Request processed in 8970us (9018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390540.827393:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788390540.827981:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788390540.827992:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788390540.827997:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788390540.828000:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e85f76800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788390540.828020:0:3621:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000054645b2b): req@ffff984e86bd4700 x1875263098069504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390540.828045:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098075648:0@lo:38:kworker.0 00000100:00100000:2.0:1788390540.828131:0:17251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390540.828157:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88ad3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390540.828174:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098069504 00000100:00100000:2.0:1788390540.828180:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098069504 00000100:00100000:2.0:1788390540.828237:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390540.828247:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17251:x1875263098069504:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788390540.828352:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17251:x1875263098069504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390540.828359:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390540.828388:0:17251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17251:1875263098069504:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788390540.828429:0:17251:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788390540.828543:0:17251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883afb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17251:1875263098076416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788390540.828575:0:17251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390540.828600:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1788390540.828611:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098076416 00000100:00100000:2.0:1788390540.828615:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098076416 00000100:00100000:2.0:1788390540.828637:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390540.828644:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17251:x1875263098076416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788390540.828856:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098076544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788390540.828885:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390540.828940:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17251:x1875263098076416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 295us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390540.828947:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390540.828958:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098076544 00000100:00100000:2.0:1788390540.828961:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098076544 00000100:00100000:2.0:1788390540.828974:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390540.828979:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098076544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788390540.829068:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788390540.829114:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098076544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390540.829121:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390540.829158:0:17251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883afb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17251:1875263098076416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788390540.829161:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098076544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788390540.829240:0:17251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883afb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17251:1875263098076672:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788390540.829274:0:17251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390540.829571:0:17251:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1ab780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390540.830926:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098076672 00000100:00100000:1.0:1788390540.831802:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098076672 00000100:00100000:1.0:1788390540.831876:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390540.831886:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17251:x1875263098076672:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788390540.832022:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17251:x1875263098076672:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 137us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390540.832031:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390540.832167:0:17251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883afb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17251:1875263098076672:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788390540.832233:0:17251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390540.834961:0:17251:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788390540.835041:0:17251:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 10, retries 0 00000004:00080000:0.0:1788390540.835047:0:17251:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788390541.202354:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390541.916796:0:18211:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788390542.225441:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390542.420239:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788390542.515601:0:18264:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390542.515797:0:18264:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788390543.116448:0:18314:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788390543.116597:0:18314:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788390543.249548:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390543.824279:0:18362:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc04d20020 20000000:00000080:3.0:1788390543.824293:0:18362:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984fabc7dc00 uarg=0000000000000000 20000000:01000000:3.0:1788390543.824432:0:18362:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788390543.824439:0:18362:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788390543.824443:0:18362:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788390543.824784:0:18363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788390543.824890:0:18362:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788390543.831898:0:18362:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788390543.831960:0:18362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390543.831993:0:18362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98780 expref: 17 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390543.832002:0:18362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98883 expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390543.832010:0:18362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390543.832055:0:18362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be98883 expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390543.832070:0:18362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be98883 expref: 17 pid: 17204 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390543.832083:0:18362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18362:1875263098076800:0@lo:104: 00000100:00100000:3.0:1788390543.832144:0:18362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390543.832208:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098076800 00010000:00010000:3.0:1788390543.832218:0:18362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be98780 expref: 17 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390543.832221:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098076800 00010000:00010000:3.0:1788390543.832231:0:18362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be98780 expref: 17 pid: 17202 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390543.832240:0:18362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18362:1875263098076928:0@lo:104: 00000100:00100000:3.0:1788390543.832263:0:18362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390543.832516:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098076928 00000100:00100000:0.0:1788390543.832519:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098076928 00000100:00100000:0.0:1788390543.832535:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390543.832550:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:18362:x1875263098076800:12345-0@lo:104: 00010000:00010000:0.0:1788390543.832560:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390543.832597:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390543.832601:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:18362:x1875263098076800:12345-0@lo:104: Request processed in 61us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390543.832605:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390543.832620:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390543.832624:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:18362:x1875263098076928:12345-0@lo:104: 00010000:00010000:0.0:1788390543.832629:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390543.832646:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788390543.832649:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:18362:x1875263098076928:12345-0@lo:104: Request processed in 26us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390543.832653:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390543.832797:0:18362:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef46e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788390543.832815:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788390543.832822:0:18362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18362:1875263098076800:0@lo:104: 00010000:00010000:1.0:1788390543.832823:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833312:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1400 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390543.833316:0:17964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833337:0:17964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390543.833343:0:17964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390543.833346:0:17964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788390543.833370:0:17964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833374:0:17964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390543.833397:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833402:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e87ba1400/0xe156d0713be98883 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9888a expref: -99 pid: 17941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833410:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390543.833412:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833415:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390543.833417:0:17964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833421:0:17964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390543.833424:0:17964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390543.833427:0:17964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788390543.833435:0:17964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833438:0:17964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390543.833446:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833450:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f846d5200/0xe156d0713be98780 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98787 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833464:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390543.833465:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390543.833466:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390543.833473:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390543.833482:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3623:1875263098077184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390543.833509:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390543.833532:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098077184 00000100:00100000:1.0:1788390543.833535:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098077184 00010000:00010000:1.0:1788390543.833560:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98780 expref: 18 pid: 17202 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390543.833576:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390543.833580:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:3623:x1875263098077184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390543.833587:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390543.833591:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98780 expref: 18 pid: 17202 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833597:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be98780 expref: 18 pid: 17202 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.833608:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390543.833625:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:3623:x1875263098077184:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390543.833629:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390543.833647:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3623:1875263098077184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390543.833706:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390543.833714:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3625:1875263098077056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390543.833733:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390543.833773:0:18362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cf200/0xe156d0713be98787 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be98780 expref: 17 pid: 17202 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390543.833786:0:18362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18362:1875263098076928:0@lo:104: 00010000:00010000:2.0:1788390543.833803:0:18362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390543.833901:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098077056 00000100:00100000:1.0:1788390543.833905:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098077056 00010000:00010000:1.0:1788390543.833920:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98883 expref: 17 pid: 17204 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390543.833966:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390543.833973:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:3625:x1875263098077056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390543.833980:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390543.833994:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98883 expref: 17 pid: 17204 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834004:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be98883 expref: 17 pid: 17204 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834012:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cf600/0xe156d0713be9888a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be98883 expref: 17 pid: 17204 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834020:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834027:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834040:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834046:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834053:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834058:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834072:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfe00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390543.834076:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834083:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834095:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390543.834104:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390543.834132:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+16:3625:x1875263098077056:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390543.834138:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390543.834249:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3625:1875263098077056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390543.834382:0:18362:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390543.834397:0:18362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390543.834404:0:18362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fc20cfe00/0xe156d0713be988de lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390543.954113:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098077312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390543.954197:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390543.954774:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098077312 00000100:00100000:2.0:1788390543.954782:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098077312 00000100:00100000:2.0:1788390543.954831:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390543.954841:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098077312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390543.954872:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788390543.954932:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098077312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390543.954940:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390543.955221:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098077312:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788390544.275001:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788390544.913516:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390544.913524:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984f85302000 from 13 10000000:01000000:0.0:1788390544.913527:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390544.913578:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390544.913589:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390544.913603:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390544.913635:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390544.913711:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390544.915885:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098077440 00000100:00100000:1.0:1788390544.915903:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098077440 00000100:00100000:1.0:1788390544.916009:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788390544.916021:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+16:17206:x1875263098077440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390544.916047:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390544.916068:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be988e5 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390544.916095:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be988e5 expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390544.916124:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be988e5 expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390544.916133:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5800, rc 0) 00000100:00100000:1.0:1788390544.916207:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098077440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390544.916214:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788390544.916731:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f894cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390544.916758:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390544.916777:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390544.916789:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390544.916873:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390544.916970:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390544.917008:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f894cdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390544.918356:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098077568 00000100:00100000:2.0:1788390544.918666:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098077568 00000100:00100000:2.0:1788390544.918727:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788390544.918739:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098077568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390544.918902:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098077568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390544.918918:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788390544.918985:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390544.919026:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390544.919071:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390544.919103:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f894cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390544.919119:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098077696 00000100:00100000:1.0:1788390544.919124:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098077696 00000100:00100000:1.0:1788390544.919151:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390544.919169:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098077696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390544.919253:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098077696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390544.919260:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788390544.919273:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788390544.921723:0:18434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788390544.924605:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788390544.924648:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390544.924661:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390544.924674:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390544.924685:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390544.924688:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fa27ae800 from 13 10000000:01000000:0.0:1788390544.924691:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390544.924741:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390544.924750:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390544.924763:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390544.924789:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390544.924871:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390544.924969:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f894cdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390544.926829:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098077824 00000100:00100000:2.0:1788390544.926844:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098077824 00000100:00100000:2.0:1788390544.926910:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788390544.926921:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+17:17206:x1875263098077824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390544.926939:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390544.926957:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be988f3 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390544.926985:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be988f3 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390544.926997:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be988f3 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390544.927007:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1000, rc 0) 00000100:00100000:2.0:1788390544.927086:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17206:x1875263098077824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390544.927093:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788390544.927154:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390544.927182:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390544.927191:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390544.927265:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390544.927345:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390544.927375:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098077952 00000100:00100000:0.0:1788390544.927380:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098077952 00000100:00100000:0.0:1788390544.927407:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788390544.927415:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17206:x1875263098077952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390544.927446:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390544.927616:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17206:x1875263098077952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390544.927624:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788390544.927634:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098077952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390544.927661:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098078080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390544.927700:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390544.927721:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1abc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390544.927759:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098078080 00000100:00100000:1.0:1788390544.927764:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098078080 00000100:00100000:1.0:1788390544.927828:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788390544.927836:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17206:x1875263098078080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390544.927922:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:17206:x1875263098078080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390544.927928:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788390544.927949:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098078080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788390544.931290:0:18435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788390544.931567:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788390544.931601:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390544.931613:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390544.931635:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390545.297688:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788390546.002210:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390546.002217:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788390546.002220:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390546.002223:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788390546.002245:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390546.002248:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788390546.002251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390546.002254:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788390546.002281:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098078208:0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.002367:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390546.002402:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098078720:0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.002444:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390546.002470:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390546.002476:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098078336:0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.002499:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390546.002609:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098078464:0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.002641:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390546.002660:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390546.002666:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098078592:0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.002730:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390546.002781:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098078208 00000100:00100000:0.0:1788390546.002788:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098078208 00000100:00100000:0.0:1788390546.002834:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788390546.002844:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:3624:x1875263098078208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.002895:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:3624:x1875263098078208:12345-0@lo:400:kworker.0 Request processed in 52us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390546.002903:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788390546.003020:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098078720 00000100:00100000:0.0:1788390546.003025:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098078720 00000100:00100000:0.0:1788390546.003050:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098078464 00000100:00100000:0.0:1788390546.003053:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098078464 00000100:00100000:0.0:1788390546.003068:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390546.003074:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098078720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.003109:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098078720:12345-0@lo:400:kworker.0 Request processed in 35us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390546.003116:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390546.003129:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390546.003135:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098078464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.003187:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098078464:12345-0@lo:400:kworker.0 Request processed in 53us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390546.003193:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390546.003211:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098078336 00000100:00100000:0.0:1788390546.003215:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098078336 00000100:00100000:0.0:1788390546.003235:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098078592 00000100:00100000:0.0:1788390546.003237:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098078592 00000100:00100000:0.0:1788390546.003249:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390546.003254:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098078336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.003287:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098078336:12345-0@lo:400:kworker.0 Request processed in 32us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390546.003293:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390546.003306:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390546.003312:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098078592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.003363:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098078592:12345-0@lo:400:kworker.0 Request processed in 51us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390546.003368:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390546.003415:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098078336:0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.003428:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098078208:0@lo:400:kworker.0 00010000:00080000:0.0:1788390546.003441:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984e88b21180 x1875263098078720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390546.003451:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098078720:0@lo:400:kworker.0 00000100:00100000:0.0:1788390546.003483:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098078592:0@lo:400:kworker.0 00010000:00080000:0.0:1788390546.003493:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984e88b20000 x1875263098078464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390546.003673:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098078464:0@lo:400:kworker.0 00000100:00100000:3.0:1788390546.004382:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098078848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390546.004427:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390546.004602:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098078848 00000100:00100000:0.0:1788390546.004610:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098078848 00000100:00100000:0.0:1788390546.004695:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390546.004705:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1875263098078848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788390546.004738:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788390546.004835:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1875263098078848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390546.004841:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390546.008273:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098078848:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788390546.323072:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788390546.515871:0:17942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788390547.345780:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788390548.333572:0:18711:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788390548.333576:0:18711:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788390548.333578:0:18711:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788390548.333746:0:18711:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984faaba1800 00000020:01000004:2.0:1788390548.333762:0:18711:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788390548.333775:0:18711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788390548.333788:0:18711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff984fba714d28) 00000020:00000080:2.0:1788390548.333802:0:18711:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788390548.369434:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788390548.372851:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788390548.373951:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788390548.374370:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788390548.374501:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788390548.374705:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788390548.375081:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788390548.375417:0:18711:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1788390548.376952:0:18711:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788390548.377265:0:18711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788390548.377281:0:18711:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788390548.377295:0:18711:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe156d0713be98908 00000020:01000004:0.0:1788390548.377304:0:18711:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788390548.377465:0:18711:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788390548.377475:0:18711:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788390548.377481:0:18711:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788390548.377485:0:18711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788390548.377505:0:18711:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff984f9c064d28) 00000020:00000080:0.0:1788390548.377514:0:18711:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788390548.378603:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390548.378760:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788390548.378767:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788390548.384122:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788390548.384142:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788390548.384700:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788390548.384707:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788390548.386576:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390548.386789:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788390548.386793:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788390548.387905:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788390548.387917:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788390548.403768:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390548.404096:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788390548.404103:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788390548.405967:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390548.405977:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788390548.406871:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788390548.406880:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788390548.409542:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390548.409808:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788390548.409815:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788390548.410565:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788390548.410573:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788390548.442956:0:18711:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390548.443313:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788390548.443437:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788390548.445574:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788390548.445593:0:18711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788390548.446303:0:18711:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788390548.446461:0:18711:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788390548.446469:0:18711:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788390548.466296:0:18711:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788390548.466377:0:18711:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.111@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788390548.466382:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788390548.466385:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788390548.466386:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390548.466388:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390548.466389:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390548.466396:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390548.466398:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390548.466399:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390548.466400:0:18711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390548.466404:0:18711:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788390548.466406:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390548.466407:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788390548.466408:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390548.466409:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390548.466410:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390548.466411:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390548.466412:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390548.466413:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390548.466414:0:18711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390548.466441:0:18711:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788390548.466464:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098078976:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390548.466533:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390548.466568:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f99f8fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390548.466673:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098078976 00000100:00100000:1.0:1788390548.466682:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098078976 00000100:00100000:1.0:1788390548.466742:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788390548.466752:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:18711:x1875263098078976:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788390548.466782:0:17202:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788390548.466785:0:17202:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788390548.466788:0:17202:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788390548.467229:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:18711:x1875263098078976:12345-0@lo:253:mount.lustre.0 Request processed in 477us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390548.467238:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788390548.467356:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098078976:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788390548.467367:0:18711:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788390548.467369:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390548.467371:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788390548.467372:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390548.467374:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390548.467375:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390548.467376:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390548.467376:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390548.467378:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390548.467379:0:18711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788390548.467401:0:18711:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984faaba1800 from lustre-OST0000 10000000:01000000:0.0:1788390548.467426:0:18711:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788390548.467429:0:18711:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788390548.467437:0:18711:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984fbac0cd28 local copy 00010000:00010000:0.0:1788390548.467447:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390548.467538:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390548.467559:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390548.467591:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f99f8f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788390548.467737:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098079104 00000100:00100000:2.0:1788390548.467741:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098079104 00000100:00100000:2.0:1788390548.467768:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788390548.467774:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e81a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:18711:x1875263098079104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390548.467861:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e81a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:18711:x1875263098079104:12345-0@lo:501:mount.lustre.0 Request processed in 87us (301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390548.467865:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788390548.468470:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079104:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788390548.468482:0:18711:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788390548.468503:0:18711:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788390548.468509:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.468515:0:18711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390548.468537:0:18711:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984faaba1800 10000000:01000000:1.0:1788390548.468540:0:18711:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788390548.468544:0:18711:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788390548.468545:0:18711:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390548.468549:0:18711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788390548.468551:0:18711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788390548.468579:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5400/0xe156d0713be98916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.468585:0:18711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d5400/0xe156d0713be98916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.468591:0:18711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d5400/0xe156d0713be98916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390548.468602:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390548.468695:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390548.468739:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb131600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390548.469490:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098079232 00000100:00100000:0.0:1788390548.469498:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098079232 00000100:00100000:0.0:1788390548.469539:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788390548.469545:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e81a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+18:18711:x1875263098079232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390548.469556:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390548.469567:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a81e00/0xe156d0713be9891d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98916 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390548.469585:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a81e00/0xe156d0713be9891d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98916 expref: 19 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390548.469592:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a81e00/0xe156d0713be9891d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98916 expref: 19 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390548.469598:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81e00, rc 0) 00000100:00100000:0.0:1788390548.469644:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e81a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079232:12345-0@lo:101:mount.lustre.0 Request processed in 98us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390548.469648:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788390548.469774:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390548.469788:0:18711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d5400/0xe156d0713be98916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9891d expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.469794:0:18711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d5400/0xe156d0713be98916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9891d expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390548.470835:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788390548.471568:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390548.473730:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788390548.473857:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788390548.473874:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788390548.473887:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788390548.473899:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788390548.473912:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788390548.473937:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788390548.473943:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788390548.474120:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390548.474204:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390548.474299:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb76b2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390548.474387:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098079360 00000100:00100000:0.0:1788390548.474395:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098079360 00000100:00100000:0.0:1788390548.474484:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788390548.474495:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390548.474654:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079360:12345-0@lo:501:mount.lustre.0 Request processed in 161us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390548.474669:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788390548.474775:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390548.474808:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788390548.474848:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390548.475058:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390548.475209:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098079488 00000100:00100000:1.0:1788390548.475214:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098079488 00000100:00100000:1.0:1788390548.475238:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788390548.475243:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079488:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390548.476058:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079488:12345-0@lo:503:mount.lustre.0 Request processed in 811us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390548.476067:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788390548.476225:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079488:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788390548.476691:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390548.476776:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390548.476823:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390548.476846:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390548.477084:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098079616 00000100:00100000:1.0:1788390548.477091:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098079616 00000100:00100000:1.0:1788390548.477120:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788390548.477143:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390548.477477:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079616:12345-0@lo:502:mount.lustre.0 Request processed in 335us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390548.477486:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788390548.477574:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788390548.477906:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788390548.477937:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788390548.477953:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788390548.477968:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788390548.477998:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788390548.478200:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788390548.478214:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788390548.478227:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788390548.478241:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788390548.478255:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788390548.478269:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788390548.478281:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788390548.478311:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390548.478734:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390548.478907:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88711cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390548.478939:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098079744 00000100:00100000:1.0:1788390548.478944:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098079744 00000100:00100000:1.0:1788390548.479023:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788390548.479032:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390548.479140:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079744:12345-0@lo:502:mount.lustre.0 Request processed in 109us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390548.479147:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788390548.479219:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788390548.479263:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788390548.479273:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788390548.480140:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788390548.480149:0:18728:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788390548.480157:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.480159:0:18728:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788390548.480175:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788390548.480188:0:18728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff984fba710000) 00000020:00000080:2.0:1788390548.480207:0:18728:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788390548.480211:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788390548.480284:0:18728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984faaba1800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788390548.480290:0:18728:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788390548.480295:0:18728:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe156d0713be9892b 00010000:00010000:2.0:1788390548.483715:0:18728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788390548.484202:0:18728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788390548.485861:0:18728:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788390548.487204:0:18728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788390548.487216:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390548.487222:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.487224:0:18728:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788390548.487228:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788390548.487230:0:18728:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788390548.487232:0:18728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788390548.487234:0:18728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788390548.487235:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788390548.487238:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.487239:0:18728:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788390548.487242:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390548.487244:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.487245:0:18728:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788390548.487248:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788390548.487250:0:18728:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788390548.487252:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390548.487254:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.487256:0:18728:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788390548.487258:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390548.487260:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.487261:0:18728:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788390548.487264:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788390548.487287:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390548.487295:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.487297:0:18728:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788390548.487300:0:18728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788390548.487536:0:18711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788390548.487569:0:18711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788390548.487592:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5400/0xe156d0713be98916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9891d expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.487605:0:18711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d5400/0xe156d0713be98916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9891d expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390548.487613:0:18711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984faaba1800 from 1 10000000:01000000:3.0:1788390548.487616:0:18711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390548.487662:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.487670:0:18711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.487679:0:18711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390548.487697:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390548.487756:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390548.487789:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef469c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390548.487876:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098079872 00000100:00100000:2.0:1788390548.487881:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098079872 00000100:00100000:2.0:1788390548.487913:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788390548.487920:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:18711:x1875263098079872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390548.487931:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390548.487940:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98932 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.487957:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98932 expref: 20 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.487964:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98932 expref: 20 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.487970:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba0600, rc 0) 00000100:00100000:2.0:1788390548.488019:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098079872:12345-0@lo:101:mount.lustre.0 Request processed in 99us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390548.488026:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788390548.488154:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098079872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390548.488170:0:18711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.488179:0:18711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390548.489121:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788390548.489409:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390548.489684:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788390548.489712:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788390548.489730:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788390548.489736:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788390548.489796:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390548.489848:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390548.489876:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef46840 going to sleep for 11 seconds 00000100:00100000:1.0:1788390548.489955:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098080000 00000100:00100000:1.0:1788390548.489962:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098080000 00000100:00100000:1.0:1788390548.490014:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788390548.490024:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098080000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390548.490141:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098080000:12345-0@lo:501:mount.lustre.0 Request processed in 118us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390548.490149:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788390548.490292:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390548.490356:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390548.490396:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390548.490413:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef46840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390548.490488:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098080128 00000100:00100000:2.0:1788390548.490492:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098080128 00000100:00100000:2.0:1788390548.490512:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788390548.490518:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098080128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788390548.490600:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098080128:12345-0@lo:503:mount.lustre.0 Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390548.490607:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788390548.490739:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390548.491139:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390548.491192:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390548.491230:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390548.491265:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390548.491366:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098080256 00000100:00100000:1.0:1788390548.491371:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098080256 00000100:00100000:1.0:1788390548.491395:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788390548.491402:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098080256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390548.491484:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098080256:12345-0@lo:502:mount.lustre.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390548.491490:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788390548.491571:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390548.491784:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788390548.491811:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788390548.491826:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788390548.491838:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788390548.491850:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788390548.491862:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788390548.491874:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788390548.491887:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788390548.491899:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788390548.491914:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788390548.491926:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788390548.491946:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390548.491978:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390548.491999:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984faef469c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390548.492119:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098080384 00000100:00100000:2.0:1788390548.492137:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098080384 00000100:00100000:2.0:1788390548.492161:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788390548.492167:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098080384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390548.492234:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098080384:12345-0@lo:502:mount.lustre.0 Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390548.492241:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788390548.492424:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390548.492453:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788390548.492459:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788390548.496907:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390548.496920:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.496922:0:18732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788390548.496929:0:18732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984faaba1800 00000020:00000080:2.0:1788390548.496932:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788390548.496940:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390548.496942:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.496943:0:18732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788390548.496945:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390548.496947:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.496948:0:18732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788390548.496951:0:18732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984faaba1800 00000020:00000080:2.0:1788390548.496952:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788390548.496991:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390548.496994:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.496996:0:18732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788390548.496998:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390548.497000:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.497001:0:18732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788390548.497016:0:18732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984faaba1800 00000020:00000080:2.0:1788390548.497019:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788390548.497038:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390548.497041:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.497042:0:18732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788390548.497044:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788390548.497047:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.497055:0:18732:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788390548.497059:0:18732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984faaba1800 00000020:00000080:2.0:1788390548.497061:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788390548.497085:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788390548.497088:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788390548.497090:0:18732:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788390548.497093:0:18732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788390548.497180:0:18711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788390548.497214:0:18711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390548.497236:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.497247:0:18711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390548.497291:0:18711:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788390548.497294:0:18711:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984faaba1800 10000000:01000000:2.0:1788390548.497296:0:18711:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984faaba1800 10000000:01000000:2.0:1788390548.497299:0:18711:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788390548.497303:0:18711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984faaba1800 from 1 10000000:01000000:2.0:1788390548.497305:0:18711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788390548.497351:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba0000/0xe156d0713be98940 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.497357:0:18711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e87ba0000/0xe156d0713be98940 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.497366:0:18711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e87ba0000/0xe156d0713be98940 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390548.497386:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788390548.497445:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390548.497470:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e881f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788390548.497486:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098080512 00000100:00100000:2.0:1788390548.497492:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098080512 00000100:00100000:2.0:1788390548.497520:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788390548.497526:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:18711:x1875263098080512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390548.497536:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390548.497545:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e87ba0c00/0xe156d0713be98947 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98940 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.497564:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e87ba0c00/0xe156d0713be98947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98940 expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.497573:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e87ba0c00/0xe156d0713be98947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98940 expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.497582:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba0c00, rc 0) 00000100:00100000:2.0:1788390548.497615:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098080512:12345-0@lo:101:mount.lustre.0 Request processed in 88us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390548.498055:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788390548.498103:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390548.498117:0:18711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e87ba0000/0xe156d0713be98940 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98947 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390548.498135:0:18711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e87ba0000/0xe156d0713be98940 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98947 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390548.501098:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788390548.501415:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390548.501596:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788390548.501620:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788390548.502843:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788390548.502853:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788390548.502860:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788390548.502867:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788390548.502874:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788390548.502892:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788390548.502900:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788390548.502907:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788390548.502914:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788390548.502921:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788390548.502927:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788390548.502934:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788390548.502941:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788390548.502948:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788390548.502954:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788390548.502961:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788390548.502968:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788390548.502976:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788390548.502990:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788390548.504116:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788390548.504163:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788390548.504188:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788390548.504197:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788390548.504205:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788390548.504212:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788390548.504223:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788390548.504238:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788390548.504252:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788390548.504271:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788390548.504283:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788390548.504306:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788390548.504335:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788390548.504354:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788390548.504368:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788390548.504381:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788390548.504407:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788390548.504413:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788390548.504519:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390548.504585:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390548.506149:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098080640 00000100:00100000:3.0:1788390548.506160:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098080640 00000100:00100000:3.0:1788390548.506221:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788390548.506232:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098080640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390548.506394:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098080640:12345-0@lo:501:mount.lustre.0 Request processed in 163us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390548.506402:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788390548.506506:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e881f8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390548.506531:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390548.506572:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788390548.506617:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390548.508192:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e881f8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390548.508370:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098080768 00000100:00100000:3.0:1788390548.508377:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098080768 00000100:00100000:3.0:1788390548.508427:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788390548.508437:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098080768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390548.508555:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098080768:12345-0@lo:503:mount.lustre.0 Request processed in 119us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390548.508562:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788390548.508685:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788390548.509770:0:18711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390548.509864:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390548.509918:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390548.509955:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e881f8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390548.512413:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098080896 00000100:00100000:3.0:1788390548.512424:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098080896 00000100:00100000:3.0:1788390548.512471:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788390548.512481:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098080896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390548.515396:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098080896:12345-0@lo:502:mount.lustre.0 Request processed in 2906us (5467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390548.515413:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788390548.515785:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098080896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788390548.515988:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788390548.516070:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788390548.516079:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788390548.516086:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788390548.516092:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788390548.516099:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788390548.516106:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788390548.516120:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788390548.516142:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788390548.516162:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788390548.516175:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788390548.516187:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788390548.516200:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788390548.516213:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788390548.516225:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788390548.516239:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788390548.516263:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788390548.516277:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788390548.516289:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788390548.516302:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788390548.516314:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788390548.522442:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788390548.522475:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788390548.522490:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788390548.522503:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788390548.522517:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788390548.522528:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788390548.522541:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788390548.522553:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788390548.522565:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788390548.522576:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788390548.522589:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788390548.522821:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788390548.522842:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788390548.522858:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788390548.522873:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788390548.522886:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788390548.522898:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788390548.522912:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788390548.522924:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788390548.522947:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788390548.522959:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788390548.522973:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788390548.522986:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788390548.522998:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788390548.523090:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788390548.523105:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788390548.523118:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788390548.523199:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098081024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390548.523278:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390548.523347:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e881f8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390548.523445:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098081024 00000100:00100000:3.0:1788390548.523453:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098081024 00000100:00100000:3.0:1788390548.524104:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788390548.524116:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098081024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390548.524260:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098081024:12345-0@lo:502:mount.lustre.0 Request processed in 146us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390548.524268:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788390548.525421:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098081024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390548.525656:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788390548.525683:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788390548.525718:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098081152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390548.525778:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390548.525822:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b256c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390548.526102:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098081152 00000100:00100000:2.0:1788390548.526110:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098081152 00000100:00100000:2.0:1788390548.526171:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788390548.526180:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098081152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390548.526292:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098081152:12345-0@lo:502:mount.lustre.0 Request processed in 112us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390548.526299:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788390548.526433:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098081152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390548.526481:0:18711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788390548.526488:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788390548.527236:0:18737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788390548.527250:0:18737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff984e8742b370) 00000020:00000080:1.0:1788390548.527267:0:18737:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788390548.527351:0:18737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984faaba1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788390548.527355:0:18737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984faaba1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788390548.527357:0:18737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984faaba1800 3 00010000:00080000:1.0:1788390548.527387:0:18737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e87885000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.111@tcp at head 00010000:00010000:1.0:1788390548.529955:0:18737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788390548.530243:0:18737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788390548.530287:0:18737:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788390548.530299:0:18737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe156d0713be98955 00000100:00080000:1.0:1788390548.530308:0:18737:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390548.530314:0:18737:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff984e87885000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390548.530369:0:18737:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e86bd5500 x1875263098081280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390548.530405:0:18737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788390548.530446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390548.530450:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390548.530452:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390548.530455:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390548.530475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390548.530478:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390548.530480:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390548.530483:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788390548.530518:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1875263098081280:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788390548.530587:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390548.530678:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098081408:0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.530718:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390548.530745:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390548.530751:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098081536:0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.530786:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390548.530819:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098081664:0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.530841:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390548.530859:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390548.530865:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098081792:0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.530884:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390548.530915:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098081280 00000100:00100000:0.0:1788390548.530922:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098081280 00000100:00100000:0.0:1788390548.530941:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098081536 00000100:00100000:0.0:1788390548.530944:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098081536 00000100:00100000:0.0:1788390548.530961:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098081792 00000100:00100000:0.0:1788390548.530963:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098081792 00000100:00100000:0.0:1788390548.530985:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390548.531000:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098081536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.531052:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098081536:12345-0@lo:400:kworker.0 Request processed in 52us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390548.531059:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390548.531076:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390548.531082:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098081792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.531111:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098081792:12345-0@lo:400:kworker.0 Request processed in 29us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390548.531117:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390548.531140:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390548.531144:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263098081280:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788390548.531165:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:0.0:1788390548.531196:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe156d0713be9895c 00000004:00100000:0.0:1788390548.531212:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788390548.531242:0:17211:0:(import.c:65:import_set_state_nolock()) ffff984fc19ad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390548.531279:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875263098081280:12345-0@lo:38:llog_process_th.0 Request processed in 133us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390548.531286:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390548.531311:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098081408 00000100:00100000:0.0:1788390548.531315:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098081408 00000100:00100000:0.0:1788390548.531355:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098081664 00000100:00100000:0.0:1788390548.531359:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098081664 00000100:00100000:0.0:1788390548.531372:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788390548.531378:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098081408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.531409:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098081408:12345-0@lo:400:kworker.0 Request processed in 31us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390548.531424:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788390548.531438:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788390548.531444:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098081664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.531472:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098081664:12345-0@lo:400:kworker.0 Request processed in 28us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390548.531478:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788390548.531517:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984e86bd6300 x1875263098081792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390548.531529:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098081792:0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.531539:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098081664:0@lo:400:kworker.0 00010000:00080000:0.0:1788390548.531564:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984e86bd5f80 x1875263098081536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390548.531573:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098081536:0@lo:400:kworker.0 00000100:00100000:0.0:1788390548.531581:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098081408:0@lo:400:kworker.0 00010000:00080000:0.0:1788390548.531602:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984e86bd5500 x1875263098081280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390548.531610:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390548.531615:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788390548.531621:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788390548.531625:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788390548.531628:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e87885000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788390548.531633:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3621:1875263098081280:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1788390548.532852:0:18737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788390548.532877:0:18737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff984e8669b370) 00000020:00000080:2.0:1788390548.532900:0:18737:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788390548.532983:0:18737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984faaba1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788390548.532988:0:18737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984faaba1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788390548.532991:0:18737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984faaba1800 3 00010000:00080000:2.0:1788390548.533032:0:18737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e87888800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.111@tcp at head 00010000:00010000:2.0:1788390548.536222:0:18737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788390548.536869:0:18737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788390548.536915:0:18737:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788390548.536927:0:18737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe156d0713be9896a 00000100:00080000:2.0:1788390548.536938:0:18737:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788390548.536950:0:18737:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff984e87888800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390548.537409:0:18737:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adea00 x1875263098081920/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390548.537438:0:18737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788390548.537455:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1875263098081920:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788390548.537462:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390548.537466:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788390548.537468:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390548.537476:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788390548.537479:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390548.537482:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788390548.537485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390548.537488:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788390548.537525:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390548.537576:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098081920 00000100:00100000:0.0:1788390548.537583:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098081920 00000100:00100000:0.0:1788390548.537611:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390548.537617:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263098081920:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788390548.537640:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:0.0:1788390548.537684:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe156d0713be98971 00000004:00100000:0.0:1788390548.537699:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788390548.537730:0:17211:0:(import.c:65:import_set_state_nolock()) ffff984fb78a3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390548.537788:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875263098081920:12345-0@lo:38:llog_process_th.0 Request processed in 170us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390548.537796:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788390548.538120:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984e88adea00 x1875263098081920/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390548.538144:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390548.538151:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788390548.538158:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788390548.538162:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788390548.538164:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e87888800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788390548.538171:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3621:1875263098081920:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788390548.539193:0:18737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788390548.539314:0:18711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788390548.539366:0:18711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390548.539384:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba0000/0xe156d0713be98940 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98947 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.539405:0:18711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e87ba0000/0xe156d0713be98940 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98947 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788390548.539449:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788390548.539452:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390548.539453:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390548.539454:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390548.539456:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390548.539457:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390548.539458:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390548.539460:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390548.539461:0:18711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390548.539465:0:18711:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788390548.539467:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390548.539468:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390548.539469:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390548.539471:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390548.539472:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390548.539473:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390548.539474:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390548.539475:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390548.539476:0:18711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390548.539494:0:18711:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788390548.539508:0:18711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098082048:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788390548.539562:0:18711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390548.539592:0:18711:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85b99300 going to sleep for 11 seconds 00000100:00100000:3.0:1788390548.539760:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098082048 00000100:00100000:3.0:1788390548.539767:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098082048 00000100:00100000:3.0:1788390548.539842:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788390548.539850:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098082048:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788390548.539873:0:17204:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788390548.539885:0:17204:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788390548.547210:0:17204:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788390548.547261:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788390548.547500:0:17225:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788390548.547505:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788390548.547527:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390548.547544:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be988bb expref: 21 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390548.547552:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be988c9 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390548.547555:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:18711:x1875263098082048:12345-0@lo:253:mount.lustre.0 Request processed in 7704us (7991us total) trans 0 rc 0/0 00010000:00010000:0.0:1788390548.547560:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390548.547564:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1788390548.547593:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be988c9 expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390548.547616:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be988c9 expref: 20 pid: 17204 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390548.547630:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098082176:0@lo:104: 00000100:00100000:0.0:1788390548.547668:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390548.547732:0:18711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:18711:1875263098082048:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788390548.547747:0:18711:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788390548.547753:0:18711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788390548.547755:0:18711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390548.547763:0:18711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390548.547764:0:18711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390548.547766:0:18711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390548.547771:0:18711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390548.547773:0:18711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390548.547775:0:18711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390548.547776:0:18711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788390548.547792:0:18711:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788390548.549260:0:18711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788390548.551085:0:18711:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788390548.551092:0:18711:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788390548.551135:0:18711:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788390548.551170:0:18711:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788390548.551190:0:18711:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788390548.551205:0:18711:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788390548.551905:0:18711:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390548.552115:0:18711:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788390548.552468:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be988bb expref: 20 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390548.552485:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be988bb expref: 20 pid: 17202 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390548.552500:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098082304:0@lo:104: 00000100:00100000:0.0:1788390548.552559:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390548.553716:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098082176 00000100:00100000:3.0:1788390548.553728:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098082176 00000100:00100000:3.0:1788390548.553788:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390548.553798:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098082176:12345-0@lo:104: 00010000:00010000:3.0:1788390548.553812:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.553876:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788390548.553882:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098082176:12345-0@lo:104: Request processed in 87us (6215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390548.553900:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390548.554140:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86b25180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390548.554159:0:17193:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788390548.554163:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098082176:0@lo:104: 00000100:00100000:3.0:1788390548.554171:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098082304 00000100:00100000:3.0:1788390548.554174:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098082304 00000100:00100000:3.0:1788390548.554203:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390548.554209:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e81a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098082304:12345-0@lo:104: 00010000:00010000:3.0:1788390548.554217:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.554252:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788390548.554257:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e81a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098082304:12345-0@lo:104: Request processed in 49us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390548.554262:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788390548.554300:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390548.554305:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.554313:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1800 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390548.554316:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.554343:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390548.554351:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390548.554357:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788390548.554396:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.554408:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390548.554429:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.554436:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e87ba1800/0xe156d0713be988c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.554447:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788390548.554448:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098082432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390548.554450:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.554455:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390548.554458:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.554464:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390548.554470:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390548.554475:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788390548.554481:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390548.554492:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390548.554498:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390548.554504:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390548.554506:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788390548.554510:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f846d5000/0xe156d0713be988bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988c2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390548.554511:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098082560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390548.554528:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390548.554529:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390548.554530:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390548.554531:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390548.554556:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098082432 00000100:00100000:1.0:1788390548.554561:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098082432 00010000:00010000:1.0:1788390548.554579:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be988c9 expref: 21 pid: 17204 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390548.554604:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098082560 00000100:00100000:1.0:1788390548.554607:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098082560 00010000:00010000:1.0:1788390548.554617:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be988bb expref: 22 pid: 17202 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390548.554630:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390548.554636:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:3622:x1875263098082432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390548.554645:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390548.554651:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be988c9 expref: 22 pid: 17204 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.554662:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be988c9 expref: 22 pid: 17204 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.554675:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d4c00/0xe156d0713be988d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be988c9 expref: 22 pid: 17204 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.554698:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390548.554738:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:3622:x1875263098082432:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390548.554745:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390548.554770:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390548.554776:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f8604a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:3622:x1875263098082560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390548.554784:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390548.554788:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be988bb expref: 20 pid: 17202 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.554796:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be988bb expref: 20 pid: 17202 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.554808:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.554816:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788390548.554830:0:17196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007325423s 00010000:00010000:3.0:1788390548.555443:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390548.555624:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.555633:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.555639:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.555659:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.555665:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390548.555670:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.555678:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.555685:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.555693:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390548.555721:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f8604a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:3622:x1875263098082560:12345-0@lo:103:ldlm_bl.0 Request processed in 945us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390548.555726:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390548.555780:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098082560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390548.555785:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098082432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390548.564415:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d5600/0xe156d0713be988c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be988bb expref: 19 pid: 17202 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390548.564434:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098082304:0@lo:104: 00010000:00010000:1.0:1788390548.564460:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.564469:0:17225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.564481:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390548.564487:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a80400/0xe156d0713be98978 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390549.079614:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390549.079637:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098082688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390549.079706:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390549.079758:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098082688 00000100:00100000:2.0:1788390549.079768:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098082688 00000100:00100000:2.0:1788390549.079823:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788390549.079833:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098082688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390549.079864:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788390549.079971:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098082688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390549.079979:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390549.080052:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098082688:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788390549.183354:0:18791:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390549.183590:0:18791:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788390549.393460:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390549.586912:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390538/real 1788390538] req@ffff984e88adc000 x1875263098072064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390548 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.586944:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e88adc000 x1875263098072064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390548 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.586953:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390538/real 1788390538] req@ffff984e88addf80 x1875263098071936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390548 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.586964:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e88addf80 x1875263098071936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390548 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788390549.587007:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390549.587039:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788390549.587043:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098072064:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788390549.587049:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc18fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390549.587054:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788390549.587057:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098071936:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788390549.587177:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390549.587181:0:18488:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788390549.587184:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390549.587187:0:18488:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788390549.587202:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390549.587205:0:18488:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788390549.587208:0:18488:0:(import.c:65:import_set_state_nolock()) ffff984fc18fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390549.587213:0:18488:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 359 00000100:00080000:2.0:1788390549.587224:0:18488:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788390549.587231:0:18488:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff984fc18fa800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390549.587252:0:18488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e883ac380 x1875263098083328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788390549.587274:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390549.587277:0:18488:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788390549.587279:0:18488:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390549.587281:0:18488:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 359 00000100:00080000:2.0:1788390549.587283:0:18488:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788390549.587286:0:18488:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff984fc18fe800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390549.587296:0:18488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e883ae300 x1875263098083456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390549.587358:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098083200:0@lo:400:kworker.0 00000100:00100000:0.0:1788390549.587405:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3625:1875263098082816:0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.587417:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390549.587434:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390549.587460:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098083584:0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.587461:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098082944:0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.587482:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390549.587482:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390549.587497:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098083712:0@lo:400:kworker.0 00000100:00100000:0.0:1788390549.587512:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098082816 00000100:00100000:0.0:1788390549.587520:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098082816 00000100:00100000:2.0:1788390549.587521:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390549.587536:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788390549.587541:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098083072:0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.587559:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390549.587563:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788390549.587571:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098083840:0@lo:400:kworker.0 00000100:00100000:0.0:1788390549.587571:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:3625:x1875263098082816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.587591:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390549.587611:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098083200 00000100:00100000:0.0:1788390549.587612:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:3625:x1875263098082816:12345-0@lo:400:kworker.0 Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390549.587619:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098083200 00000100:00100000:0.0:1788390549.587620:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788390549.587642:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098082944 00000100:00100000:2.0:1788390549.587645:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098082944 00000100:00100000:2.0:1788390549.587658:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788390549.587663:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098083200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.587701:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098083200:12345-0@lo:400:kworker.0 Request processed in 38us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390549.587707:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788390549.587721:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390549.587728:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098082944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390549.587767:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098082944:12345-0@lo:400:kworker.0 Request processed in 39us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390549.587773:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390549.587811:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098083200:0@lo:400:kworker.0 00000100:00100000:1.0:1788390549.587870:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098082944:0@lo:400:kworker.0 00000100:00100000:0.0:1788390549.587909:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098083584 00000100:00100000:0.0:1788390549.587913:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098083584 00000100:00100000:0.0:1788390549.587928:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098083712 00000100:00100000:0.0:1788390549.587931:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098083712 00000100:00100000:0.0:1788390549.587958:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098083072 00000100:00100000:0.0:1788390549.587961:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098083072 00000100:00100000:0.0:1788390549.587970:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098083840 00000100:00100000:0.0:1788390549.587971:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098083840 00000100:00100000:0.0:1788390549.587991:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390549.587995:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098083584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390549.588091:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098083584:12345-0@lo:400:kworker.0 Request processed in 94us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390549.588098:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390549.588112:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390549.588129:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098083712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390549.588164:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098083712:12345-0@lo:400:kworker.0 Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390549.588170:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390549.588183:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390549.588189:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098083072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390549.588214:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098083072:12345-0@lo:400:kworker.0 Request processed in 26us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390549.588220:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390549.588232:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788390549.588237:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098083840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390549.588262:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098083840:12345-0@lo:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390549.588268:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788390549.588298:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3625:1875263098082816:0@lo:400:kworker.0 00010000:00080000:0.0:1788390549.588308:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883ac000 x1875263098083584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.588316:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098083584:0@lo:400:kworker.0 00010000:00080000:0.0:1788390549.588376:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883aea00 x1875263098083072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.588384:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098083072:0@lo:400:kworker.0 00010000:00080000:0.0:1788390549.588393:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e87419180 x1875263098083840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.588400:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098083840:0@lo:400:kworker.0 00010000:00080000:0.0:1788390549.588409:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883ad500 x1875263098083712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.588416:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098083712:0@lo:400:kworker.0 00000100:00100000:0.0:1788390549.588436:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098083328:0@lo:8:kworker.0 00000100:00100000:0.0:1788390549.588462:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390549.588478:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098083456:0@lo:8:kworker.0 00000100:00100000:0.0:1788390549.588496:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788390549.588578:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390549.588583:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390549.588599:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098083328 00000100:00100000:1.0:1788390549.588604:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098083328 00000100:00100000:1.0:1788390549.588627:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098083456 00000100:00100000:1.0:1788390549.588630:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098083456 00000100:00100000:1.0:1788390549.588652:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390549.588657:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1875263098083328:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788390549.588680:0:18716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:1.0:1788390549.588708:0:18716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be9897f 00002000:00100000:1.0:1788390549.588721:0:18716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff984e87887000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788390549.588725:0:18716:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788390549.588728:0:18716:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788390549.589005:0:18716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788390549.589040:0:18716:0:(import.c:65:import_set_state_nolock()) ffff984e87886800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390549.589087:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1875263098083328:12345-0@lo:8:kworker.0 Request processed in 428us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390549.589094:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390549.589108:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390549.589113:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1875263098083456:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788390549.589134:0:18716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788390549.590720:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883ac380 x1875263098083328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.590735:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390549.590746:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788390549.590755:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788390549.590760:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788390549.590763:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc18fa800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788390549.590790:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788390549.590797:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098083328:0@lo:8:kworker.0 00000004:00080000:3.0:1788390549.594899:0:17951:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788390549.595389:0:17951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 370153066568ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788390549.595399:0:17951:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788390549.595574:0:17952:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788390549.595623:0:17952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1875263098084096:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788390549.595698:0:17952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390549.595726:0:17952:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f894cd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788390549.595741:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390549.595752:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098083968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390549.595788:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390549.603394:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098083968 00000100:00100000:0.0:1788390549.603419:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098083968 00000100:00100000:0.0:1788390549.603480:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390549.603491:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875263098083968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788390549.603514:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788390549.603600:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875263098083968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (7822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390549.603607:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788390549.603676:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e88aded80 x1875263098083968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.603696:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098083968:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788390549.603918:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390549.603981:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1875263098083456:12345-0@lo:8:kworker.0 Request processed in 14866us (15483us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788390549.603990:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390549.604004:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098084096 00000100:00100000:1.0:1788390549.604008:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098084096 00000100:00100000:1.0:1788390549.604052:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390549.604059:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17952:x1875263098084096:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1788390549.604743:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390549.604748:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788390549.604752:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098083456:0@lo:8:kworker.0 00000004:00080000:0.0:1788390549.605196:0:17942:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788390549.606463:0:18718:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788390549.606472:0:18718:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788390549.606566:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17952:x1875263098084096:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2504us (10866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390549.606581:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788390549.606807:0:17952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e88adca80 x1875263098084096/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788390565 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390549.606822:0:17952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1875263098084096:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788390549.606835:0:17952:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788390549.606876:0:17952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1875263098084224:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788390549.606912:0:17952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390549.606938:0:17952:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f86191d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390549.606960:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098084224 00000100:00100000:1.0:1788390549.606967:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098084224 00000100:00100000:1.0:1788390549.607005:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390549.607180:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17952:x1875263098084224:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788390549.607205:0:18717:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788390549.607254:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17952:x1875263098084224:12345-0@lo:5:osp-pre-0-1.0 Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390549.607260:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788390549.607346:0:17952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e86bd4a80 x1875263098084224/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390565 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.607356:0:17952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1875263098084224:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788390549.607365:0:17952:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788390549.607390:0:17952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1875263098084352:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788390549.607413:0:17952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390549.607437:0:17952:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071240 going to sleep for 11 seconds 00000100:00100000:1.0:1788390549.607489:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098084352 00000100:00100000:1.0:1788390549.607494:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098084352 00000100:00100000:1.0:1788390549.607521:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390549.607528:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17952:x1875263098084352:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788390549.607554:0:18718:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1788390549.620742:0:18712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788390549.620755:0:18712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788390549.620968:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17952:x1875263098084352:12345-0@lo:5:osp-pre-0-1.0 Request processed in 13436us (13550us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788390549.620977:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788390549.621135:0:17952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fed80 x1875263098084352/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390565 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390549.621147:0:17952:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788390549.621154:0:17952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17952:1875263098084352:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788390549.621170:0:17952:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788390549.621220:0:17952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17952:1875263098084480:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788390549.621255:0:17952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390549.621288:0:17952:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390549.621378:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098084480 00000100:00100000:2.0:1788390549.621384:0:17221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098084480 00000100:00100000:2.0:1788390549.621414:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390549.621420:0:17221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17952:x1875263098084480:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788390549.621460:0:17221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17952:x1875263098084480:12345-0@lo:900:osp-pre-0-1.0 Request processed in 41us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390549.621464:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788390549.621524:0:17952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fed80 x1875263098084480/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788390565 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390549.621531:0:17952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17952:1875263098084480:0@lo:900:osp-pre-0-1.0 10000000:01000000:3.0:1788390549.649465:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390549.649474:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984f85302000 from 9 10000000:01000000:3.0:1788390549.649480:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390549.649541:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390549.649555:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390549.649566:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390549.649597:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098084608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390549.649698:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390549.649749:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f894cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788390549.649845:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098084608 00000100:00100000:0.0:1788390549.649856:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098084608 00000100:00100000:0.0:1788390549.649920:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788390549.649931:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+19:17206:x1875263098084608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390549.649945:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390549.649960:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98986 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390549.649989:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98986 expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390549.650000:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98986 expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390549.650009:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80000, rc 0) 00000100:00100000:0.0:1788390549.650057:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:17206:x1875263098084608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390549.650064:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788390549.650195:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098084608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390549.650215:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390549.650225:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390549.650279:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098084736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788390549.650312:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390549.650413:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f894cd180 going to sleep for 11 seconds 00000100:00100000:2.0:1788390549.650574:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098084736 00000100:00100000:2.0:1788390549.650579:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098084736 00000100:00100000:2.0:1788390549.650650:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788390549.650659:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:17206:x1875263098084736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788390549.650682:0:17202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788390549.650697:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788390549.650700:0:17202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788390549.650782:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:17206:x1875263098084736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390549.650790:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788390549.650849:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098084736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788390549.650905:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390549.650912:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390549.650920:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390549.650929:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390549.650932:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984fa27ae800 from 9 10000000:01000000:3.0:1788390549.650934:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390549.650951:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390549.650958:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390549.650975:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390549.650987:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098084864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390549.651012:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390549.651094:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f894cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788390549.651142:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098084864 00000100:00100000:0.0:1788390549.651148:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098084864 00000100:00100000:0.0:1788390549.651168:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788390549.651176:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:17206:x1875263098084864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390549.651184:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390549.651193:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98994 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390549.651208:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98994 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390549.651215:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98994 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390549.651223:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81c00, rc 0) 00000100:00100000:0.0:1788390549.651259:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:17206:x1875263098084864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390549.651265:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788390549.651350:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098084864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390549.651361:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390549.651369:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390549.651403:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098084992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788390549.651428:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390549.651455:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f894cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788390549.651557:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098084992 00000100:00100000:0.0:1788390549.651562:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098084992 00000100:00100000:0.0:1788390549.651579:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788390549.651585:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:17206:x1875263098084992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788390549.651594:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390549.651605:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390549.651608:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788390549.651675:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:17206:x1875263098084992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390549.651682:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788390549.651751:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098084992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788390549.651786:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390549.651792:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390549.651800:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390550.034682:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788390550.418962:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390551.123474:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390551.124427:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098085120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390551.124500:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390551.127240:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098085120 00000100:00100000:0.0:1788390551.127259:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098085120 00000100:00100000:3.0:1788390551.127435:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390551.127456:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098085120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788390551.127498:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788390551.127585:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098085120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390551.127593:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390551.127690:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098085120:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788390551.441417:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390552.345781:0:19080:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788390552.466872:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390552.658698:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788390552.928678:0:19132:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390552.928895:0:19132:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788390553.490764:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788390553.530219:0:19182:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788390553.530816:0:19182:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788390554.193740:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390554.193771:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098085248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788390554.193864:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390554.194023:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098085248 00000100:00100000:1.0:1788390554.194034:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098085248 00000100:00100000:1.0:1788390554.194104:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788390554.194116:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098085248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788390554.194161:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788390554.194228:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098085248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390554.194495:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788390554.194551:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098085248:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788390554.514063:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788390554.705995:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390554.706004:0:18488:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788390554.706007:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390554.706011:0:18488:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788390554.706041:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390554.706044:0:18488:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788390554.706049:0:18488:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788390554.706050:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098085504:0@lo:400:kworker.0 00000100:00080000:0.0:1788390554.706058:0:18488:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 370 00000100:00080000:0.0:1788390554.706064:0:18488:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788390554.706082:0:18488:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff984fc18fe800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390554.706107:0:18488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e883ff100 x1875263098086144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390554.706145:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390554.706148:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098085760:0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.706184:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390554.706209:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098086400:0@lo:400:kworker.0 00000100:00100000:1.0:1788390554.706219:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098086016:0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.706224:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390554.706240:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788390554.706245:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098085376:0@lo:400:kworker.0 00000100:00100000:1.0:1788390554.706254:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390554.706272:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390554.706281:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788390554.706291:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098085632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390554.706298:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098085888:0@lo:400:kworker.0 00000100:00100000:1.0:1788390554.706343:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390554.706354:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390554.706362:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098086272:0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.706383:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098086528:0@lo:400:kworker.0 00000100:00100000:1.0:1788390554.706384:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390554.706405:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098086016 00000100:00100000:1.0:1788390554.706414:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098086016 00000100:00100000:0.0:1788390554.706432:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390554.706463:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098085504 00000100:00100000:0.0:1788390554.706468:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098085504 00000100:00100000:1.0:1788390554.706476:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390554.706489:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098086016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.706500:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098085888 00000100:00100000:0.0:1788390554.706505:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098085888 00000100:00100000:0.0:1788390554.706522:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390554.706530:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098085504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390554.706546:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098086016:12345-0@lo:400:kworker.0 Request processed in 60us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390554.706554:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390554.706571:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098085504:12345-0@lo:400:kworker.0 Request processed in 41us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390554.706579:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788390554.706580:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390554.706604:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788390554.706613:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fd880 x1875263098086016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390554.706614:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098085888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390554.706628:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098085632 00000100:00100000:1.0:1788390554.706633:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098086016:0@lo:400:kworker.0 00000100:00100000:2.0:1788390554.706636:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098085632 00000100:00100000:0.0:1788390554.706649:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098085888:12345-0@lo:400:kworker.0 Request processed in 37us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390554.706655:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098085504:0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.706656:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390554.706682:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098085760 00000100:00100000:0.0:1788390554.706685:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098085760 00000100:00100000:2.0:1788390554.706689:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390554.706703:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098086400 00000100:00100000:0.0:1788390554.706705:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098086400 00000100:00100000:0.0:1788390554.706727:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098086272 00000100:00100000:1.0:1788390554.706728:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098085888:0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.706731:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098086272 00000100:00100000:0.0:1788390554.706745:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098086528 00000100:00100000:0.0:1788390554.706748:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098086528 00000100:00080000:1.0:1788390554.706767:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390554.706770:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788390554.706773:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390554.706781:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098085760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390554.706801:0:17211:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788390554.706809:0:17211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788390554.706819:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098085760:12345-0@lo:400:kworker.0 Request processed in 40us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390554.706827:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390554.706830:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098085376 00000100:00100000:1.0:1788390554.706836:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098085376 00000100:00100000:0.0:1788390554.706847:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390554.706855:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098086400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390554.706865:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788390554.706872:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:3622:x1875263098085376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.706887:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098086400:12345-0@lo:400:kworker.0 Request processed in 33us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390554.706894:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788390554.706904:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:3622:x1875263098085376:12345-0@lo:400:kworker.0 Request processed in 33us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390554.706910:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788390554.706913:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390554.706923:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098086272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390554.706947:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098085376:0@lo:400:kworker.0 00010000:00080000:1.0:1788390554.706957:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fc700 x1875263098085760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390554.706965:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098085760:0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.706966:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875263098086272:12345-0@lo:400:kworker.0 Request processed in 43us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390554.706974:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788390554.706977:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fe300 x1875263098086400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390554.706984:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098086400:0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.706997:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390554.707006:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098086528:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788390554.707017:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fca80 x1875263098086272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390554.707026:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875263098086272:0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.707046:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098086528:12345-0@lo:400:kworker.0 Request processed in 41us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390554.707051:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788390554.707062:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fdc00 x1875263098086528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390554.707084:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098086528:0@lo:400:kworker.0 00000100:00100000:0.0:1788390554.707110:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098086144:0@lo:8:kworker.0 00000100:00100000:0.0:1788390554.707138:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390554.707154:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098085632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788390554.707187:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788390554.707240:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098085632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 543us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390554.707247:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390554.707366:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098086144 00000100:00100000:1.0:1788390554.707370:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098086144 00000100:00100000:1.0:1788390554.707392:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390554.707396:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3621:x1875263098086144:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788390554.707413:0:18718:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788390554.708146:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e86bd7480 x1875263098085632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390554.708165:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098085632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390554.714967:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3621:x1875263098086144:12345-0@lo:8:kworker.0 Request processed in 7561us (7821us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788390554.714978:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788390554.715049:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390554.715055:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788390554.715058:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098086144:0@lo:8:kworker.0 00010000:00010000:3.0:1788390555.537521:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390555.732164:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390540/real 1788390540] req@ffff984e88adc380 x1875263098075776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390555.732201:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e88adc380 x1875263098075776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390555.732211:0:3621:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390540/real 1788390540] req@ffff984e88ade680 x1875263098075904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390555.732237:0:3621:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984e88ade680 x1875263098075904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788390555.732260:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f8a4f1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390555.732287:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788390555.732292:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098075776:0@lo:8:kworker.0 00000100:00080000:1.0:1788390555.732298:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e877d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390555.732304:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788390555.732306:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098075904:0@lo:8:kworker.0 00000100:00080000:0.0:1788390555.732669:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390555.732676:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788390555.732680:0:37:0:(import.c:65:import_set_state_nolock()) ffff984f8a4f1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390555.732687:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 361 00000100:00080000:0.0:1788390555.732693:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788390555.732721:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff984f8a4f1800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390555.732748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e883fe300 x1875263098086912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788390555.732761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390555.732765:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788390555.732767:0:37:0:(import.c:65:import_set_state_nolock()) ffff984e877d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390555.732770:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 361 00000100:00080000:0.0:1788390555.732772:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788390555.732776:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984e877d0800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390555.732787:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e883fc700 x1875263098087040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788390555.732828:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390555.732832:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788390555.732833:0:37:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390555.732837:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 375 00000100:00080000:0.0:1788390555.732840:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788390555.732844:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff984fc18fe800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390555.732857:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e883fd880 x1875263098087552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788390555.732907:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098086784:0@lo:400:kworker.0 00000100:00100000:0.0:1788390555.732994:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390555.733032:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098087680:0@lo:400:kworker.0 00000100:00100000:0.0:1788390555.733083:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390555.733106:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788390555.733118:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3625:1875263098086656:0@lo:400:kworker.0 00000100:00100000:0.0:1788390555.733150:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390555.733179:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098087424:0@lo:400:kworker.0 00000100:00100000:0.0:1788390555.733202:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.733396:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098087168:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.733435:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.733456:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098087808:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.733474:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.733492:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788390555.733496:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098087296:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.733516:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.733531:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098087936:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.733549:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.733592:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098087424 00000100:00100000:1.0:1788390555.733600:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098087424 00000100:00100000:1.0:1788390555.733658:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390555.733668:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098087424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.733718:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098087424:12345-0@lo:400:kworker.0 Request processed in 51us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.733726:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390555.733750:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098087680 00000100:00100000:1.0:1788390555.733753:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098087680 00000100:00100000:1.0:1788390555.733770:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098087168 00000100:00100000:1.0:1788390555.733773:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098087168 00000100:00100000:1.0:1788390555.733784:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098087808 00000100:00100000:1.0:1788390555.733786:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098087808 00000100:00100000:1.0:1788390555.733798:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098087936 00000100:00100000:1.0:1788390555.733801:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098087936 00000100:00100000:1.0:1788390555.733814:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390555.733821:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098087680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.733854:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098087680:12345-0@lo:400:kworker.0 Request processed in 33us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.733861:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390555.733883:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390555.733890:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098087168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.733925:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098087168:12345-0@lo:400:kworker.0 Request processed in 36us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.733930:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390555.733941:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390555.733947:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098087808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.733973:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098087808:12345-0@lo:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.733979:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390555.733989:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390555.733994:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098087936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.734021:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875263098087936:12345-0@lo:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.734027:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390555.734050:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098086784 00000100:00100000:1.0:1788390555.734053:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098086784 00000100:00100000:1.0:1788390555.734090:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098087296 00000100:00100000:1.0:1788390555.734093:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098087296 00000100:00100000:1.0:1788390555.734105:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390555.734111:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098086784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.734145:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098086784:12345-0@lo:400:kworker.0 Request processed in 33us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.734150:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390555.734161:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390555.734167:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098087296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.734201:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098087296:12345-0@lo:400:kworker.0 Request processed in 35us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.734208:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390555.734271:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098087296:0@lo:400:kworker.0 00010000:00080000:1.0:1788390555.734283:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e8884ce00 x1875263098087936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390555.734293:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3622:1875263098087936:0@lo:400:kworker.0 00010000:00080000:1.0:1788390555.734303:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883ff800 x1875263098087168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390555.734311:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098087168:0@lo:400:kworker.0 00010000:00080000:1.0:1788390555.734344:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e8884e300 x1875263098087808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390555.734354:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098087808:0@lo:400:kworker.0 00000100:00100000:1.0:1788390555.734385:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098086912:0@lo:8:kworker.0 00000100:00100000:1.0:1788390555.734413:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.734432:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098087040:0@lo:8:kworker.0 00000100:00100000:1.0:1788390555.734457:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.734471:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098087552:0@lo:8:kworker.0 00000100:00100000:1.0:1788390555.734494:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.734520:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098086912 00000100:00100000:1.0:1788390555.734524:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098086912 00000100:00100000:1.0:1788390555.734538:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098087040 00000100:00100000:1.0:1788390555.734540:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098087040 00000100:00100000:1.0:1788390555.734554:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098087552 00000100:00100000:1.0:1788390555.734556:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098087552 00000100:00100000:1.0:1788390555.734564:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390555.734569:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3621:x1875263098086912:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788390555.734600:0:18718:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:1.0:1788390555.734639:0:18718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be989a2 00002000:00100000:1.0:1788390555.734659:0:18718:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff984fc19e2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788390555.734665:0:18718:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788390555.734668:0:18718:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788390555.734762:0:18718:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788390555.734789:0:18718:0:(import.c:65:import_set_state_nolock()) ffff984fc19e6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390555.734828:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875263098086912:12345-0@lo:8:kworker.0 Request processed in 258us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.734835:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390555.734848:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390555.734852:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3621:x1875263098087040:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788390555.734862:0:18718:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788390555.734888:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3621:x1875263098087040:12345-0@lo:8:kworker.0 Request processed in 34us (429us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788390555.734893:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390555.734903:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390555.734906:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3621:x1875263098087552:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788390555.734914:0:18718:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788390555.734935:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3621:x1875263098087552:12345-0@lo:8:kworker.0 Request processed in 27us (439us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788390555.734940:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788390555.734976:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fe300 x1875263098086912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390555.734984:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390555.734992:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788390555.735001:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788390555.735008:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788390555.735010:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984f8a4f1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788390555.735026:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788390555.735031:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098086912:0@lo:8:kworker.0 00000100:00080000:1.0:1788390555.735042:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e877d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390555.735047:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788390555.735050:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098087040:0@lo:8:kworker.0 00000100:00080000:1.0:1788390555.735070:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390555.735074:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788390555.735077:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098087552:0@lo:8:kworker.0 00000004:00080000:1.0:1788390555.735134:0:17234:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788390555.735154:0:17234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17234:1875263098088192:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788390555.735179:0:17234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.735193:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f85921e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390555.735207:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098088064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390555.735233:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390555.735273:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098088064 00000100:00100000:1.0:1788390555.735277:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098088064 00000100:00100000:1.0:1788390555.735353:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390555.735361:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098088064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390555.735385:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788390555.735425:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875263098088064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390555.735432:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788390555.735449:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788390555.735468:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e86bd6300 x1875263098088064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390555.735482:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098088064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390555.735498:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098088192 00000100:00100000:1.0:1788390555.735500:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098088192 00000100:00100000:1.0:1788390555.735521:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390555.735526:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17234:x1875263098088192:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:0.0:1788390555.735876:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fc000 x1875263098087424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788390571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390555.735887:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098087424:0@lo:400:kworker.0 00000100:00100000:0.0:1788390555.735900:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098086784:0@lo:400:kworker.0 00010000:00080000:0.0:1788390555.735911:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e8884fb80 x1875263098087680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390555.735919:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098087680:0@lo:400:kworker.0 00000100:00100000:0.0:1788390555.735966:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098086656 00000100:00100000:0.0:1788390555.735971:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098086656 00000100:00100000:0.0:1788390555.736008:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788390555.736015:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:3625:x1875263098086656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390555.736071:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:3625:x1875263098086656:12345-0@lo:400:kworker.0 Request processed in 56us (2920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390555.736078:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788390555.736128:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3625:1875263098086656:0@lo:400:kworker.0 00000004:00080000:3.0:1788390555.736722:0:17233:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788390555.736825:0:17233:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376294503172ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788390555.736833:0:17233:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788390555.738753:0:17189:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788390555.741580:0:18718:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788390555.741595:0:18718:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788390555.741602:0:18718:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:1.0:1788390555.749496:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390555.749514:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749537:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788390555.749542:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390555.749549:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749570:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749598:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749606:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749628:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390555.749643:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390555.749649:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749657:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5000 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390555.749663:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749674:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749693:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749702:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d7d466/0xe156d0713be989a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.749722:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.749730:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.749732:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390555.750765:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390555.750776:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750790:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788390555.750794:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390555.750800:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750814:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750824:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750832:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750851:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390555.750862:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390555.750868:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750875:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390555.750879:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750902:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750916:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750925:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d56a4d42/0xe156d0713be989b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.750942:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.750944:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.750945:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390555.751360:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390555.751368:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751376:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788390555.751380:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390555.751384:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751393:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751401:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751414:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751430:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390555.751439:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390555.751444:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751451:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390555.751455:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751462:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751474:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751482:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc1fb91b/0xe156d0713be989b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751496:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.751498:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.751500:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390555.751923:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390555.751936:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751945:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788390555.751948:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390555.751951:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751960:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751969:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751976:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.751992:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390555.752000:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390555.752123:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.752133:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5200 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390555.752137:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.752146:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.752165:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.752173:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff9e4b1c/0xe156d0713be989be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.752186:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.752188:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.752190:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390555.755786:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390555.755809:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.755832:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788390555.755837:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390555.755845:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.755863:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.755875:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.755883:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.755934:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390555.755950:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390555.755956:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.755963:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390555.755969:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.755978:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.755996:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.756014:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ffb23aa/0xe156d0713be989c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.756031:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.756033:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.756035:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390555.757529:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.757544:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.757560:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.757571:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.757577:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.757593:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.757603:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.757612:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.757632:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390555.758164:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390555.758173:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.758183:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390555.758195:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.758205:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.758292:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.758301:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.758340:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.758342:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.758344:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390555.758519:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.758525:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.758534:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.758538:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.758543:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.758554:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.758617:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.758631:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.758674:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390555.762662:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390555.762681:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.762700:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390555.762706:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.762719:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.762745:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.762760:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390555.762784:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.762785:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390555.762787:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390555.763789:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390555.763802:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.763821:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788390555.763827:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390555.763837:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.763853:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.763869:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.763877:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.763897:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390555.763910:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390555.763916:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.763923:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390555.763928:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.763936:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.763949:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.763957:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be989da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390555.766609:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.766628:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.766649:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.766655:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.766662:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.766682:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.766693:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.766702:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.766732:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390555.767156:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390555.767173:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.767183:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390555.767189:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.767199:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.767221:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.767229:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7aaa5d7/0xe156d0713be989e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.767244:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.767245:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.767248:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390555.767380:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.767387:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767400:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.767403:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.767408:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767417:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767426:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767432:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767448:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390555.767457:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390555.767461:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767468:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390555.767471:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767479:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767500:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767507:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000052f9e79/0xe156d0713be989e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.767519:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.767521:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.767523:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.767954:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390555.768602:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.768612:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.768628:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.768632:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.768638:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.768651:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.768661:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.768669:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.768869:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390555.769045:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390555.769054:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769075:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390555.769081:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769104:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769121:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769128:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000141ee31b/0xe156d0713be989ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769149:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.769151:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.769153:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390555.769481:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.769486:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.769493:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.769495:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.769498:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.769507:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.769512:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.769517:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.769536:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390555.769724:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390555.769730:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769738:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390555.769746:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769754:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769766:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769785:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042747cd6/0xe156d0713be989f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390555.769801:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390555.769805:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.769806:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.769806:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.769808:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.769814:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.769823:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.769828:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.769837:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.769845:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.769853:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.769916:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390555.770365:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.770372:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.770382:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.770386:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.770390:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.770401:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.770410:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.770425:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770479:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390555.770486:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770495:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390555.770498:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770515:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770531:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770538:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ae043e/0xe156d0713be989fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770558:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390555.770561:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770567:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390555.770571:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770578:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770587:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.770594:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.770596:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.770603:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.770637:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390555.770642:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035e8db86/0xe156d0713be98a04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390555.770923:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.770929:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.770939:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.770942:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.770945:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.770954:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.770962:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.770969:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.771084:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390555.771546:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.771565:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.771576:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.771579:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.771583:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.771592:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.771599:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.771607:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.774130:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390555.774146:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.774162:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390555.774169:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.774180:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.774207:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.774216:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bc32595/0xe156d0713be98a0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.774239:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390555.774247:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.774255:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4000 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390555.774259:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.774268:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.774281:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.774291:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.774292:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.774294:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.774301:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.774303:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.774304:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.774368:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.774377:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788390555.774391:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076617f6f/0xe156d0713be98a12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390555.775215:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.775223:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775245:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.775250:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.775259:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775275:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775286:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775293:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775406:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390555.775614:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390555.775620:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.775640:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390555.775645:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.775654:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.775668:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.775676:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe509371/0xe156d0713be98a19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.775693:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.775695:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.775696:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390555.775862:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.775869:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775878:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.775882:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.775886:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775897:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775915:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775922:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.775943:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390555.776193:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390555.776199:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.776207:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4200 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390555.776210:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390555.776287:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.776293:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.776295:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.776302:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.776305:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390555.776308:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.776309:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.776317:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006270309b/0xe156d0713be98a20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.776346:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.776352:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.776354:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.776355:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.776356:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.776363:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.776393:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788390555.776762:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390555.776767:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.776775:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788390555.776779:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.776783:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.776792:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.776800:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.776808:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.776829:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788390555.776955:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390555.777041:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.777049:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5a00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390555.777053:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.777071:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.777090:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.777099:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee1ee98b/0xe156d0713be98a27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.777104:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390555.777109:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.777115:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.777117:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390555.777117:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.777118:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.777120:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.777129:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.777141:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.777160:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efe379fd/0xe156d0713be98a2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.777174:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.777176:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.777178:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390555.778184:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390555.778196:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778207:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788390555.778210:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390555.778215:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778299:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778309:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778316:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778429:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390555.778628:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390555.778635:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.778644:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390555.778649:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.778658:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.778673:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.778681:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006171c502/0xe156d0713be98a35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.778697:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.778699:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.778701:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390555.778815:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390555.778821:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778830:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788390555.778833:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390555.778836:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778845:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778852:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778860:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.778879:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788390555.779295:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390555.779303:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779312:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788390555.779360:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390555.779365:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779376:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779384:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779392:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779442:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788390555.779583:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390555.779589:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779598:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390555.779610:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779620:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779633:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779642:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e88bbb71/0xe156d0713be98a3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779656:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390555.779660:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779667:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390555.779671:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779679:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779690:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779698:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bb7e87c/0xe156d0713be98a43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.779718:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.779719:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.779721:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390555.779741:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390555.779746:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779755:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788390555.779758:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390555.779762:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779771:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779780:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779791:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.779815:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390555.780028:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390555.780034:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.780035:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.780043:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0a00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390555.780047:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.780056:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.780078:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.780086:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027f74cb8/0xe156d0713be98a4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390555.780099:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.780101:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390555.780102:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390555.780315:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390555.780340:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780350:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788390555.780353:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390555.780358:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780368:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780376:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780383:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780403:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788390555.780730:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390555.780737:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780749:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788390555.780753:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390555.780757:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780766:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780775:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780783:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.780801:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788390555.781037:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390555.781044:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.781052:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390555.781071:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.781081:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390555.781084:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390555.781090:0:18718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.781094:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781097:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788390555.781101:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390555.781102:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006285d7b8/0xe156d0713be98a51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781106:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781115:0:18718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.781117:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390555.781121:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.781128:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390555.781133:0:18718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.781136:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781142:0:18718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.781145:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.781154:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781159:0:18718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390555.781161:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d355750/0xe156d0713be98a58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781165:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390555.781169:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390555.781174:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.781175:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390555.781176:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390555.781178:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.781179:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781187:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781197:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781205:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4f7d9f0/0xe156d0713be98a5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390555.781297:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.781304:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390555.781307:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788390555.781364:0:18718:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1788390555.781491:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17234:x1875263098088192:12345-0@lo:5:osp-pre-0-0.0 Request processed in 45957us (46304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390555.781507:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390555.781639:0:17234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17234:1875263098088192:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788390555.781661:0:17234:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788390555.781716:0:17234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87418380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17234:1875263098088320:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788390555.781755:0:17234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390555.781780:0:17234:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb31fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390555.781801:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098088320 00000100:00100000:2.0:1788390555.781808:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098088320 00000100:00100000:2.0:1788390555.781852:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390555.781861:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8741b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17234:x1875263098088320:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788390555.781907:0:18717:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788390555.782131:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788390555.790160:0:18712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788390555.790222:0:18712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788390555.790703:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8741b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17234:x1875263098088320:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8833us (8938us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788390555.790717:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390555.790833:0:17234:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788390555.790844:0:17234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87418380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17234:1875263098088320:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788390555.790866:0:17234:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:1.0:1788390556.243428:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390556.243460:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098088448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390556.243552:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390556.243691:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098088448 00000100:00100000:3.0:1788390556.243708:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098088448 00000100:00100000:3.0:1788390556.243777:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390556.243789:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098088448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788390556.243835:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788390556.243898:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098088448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390556.243923:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788390556.245620:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098088448:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788390556.563509:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390557.589090:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788390558.456241:0:19528:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788390558.456245:0:19528:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788390558.456246:0:19528:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788390558.456432:0:19528:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984fc19e1000 00000020:01000004:1.0:1788390558.456448:0:19528:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788390558.456464:0:19528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788390558.456478:0:19528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff984e8742cd28) 00000020:00000080:1.0:1788390558.456496:0:19528:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788390558.485857:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788390558.488274:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788390558.488630:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788390558.489047:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788390558.489345:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788390558.489556:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788390558.489771:0:19528:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1788390558.491681:0:19528:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788390558.491914:0:19528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788390558.491930:0:19528:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788390558.491946:0:19528:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe156d0713be98a6d 00000020:01000004:0.0:1788390558.491955:0:19528:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788390558.491987:0:19528:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788390558.491990:0:19528:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788390558.491997:0:19528:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788390558.492045:0:19528:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788390558.492050:0:19528:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788390558.503716:0:19528:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788390558.503759:0:19528:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.111@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788390558.503764:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788390558.503766:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788390558.503767:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390558.503768:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390558.503770:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390558.503771:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390558.503773:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390558.503775:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390558.503782:0:19528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390558.503785:0:19528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788390558.503787:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390558.503788:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788390558.503789:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390558.503790:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390558.503791:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390558.503792:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390558.503793:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390558.503794:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390558.503794:0:19528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390558.503827:0:19528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788390558.503848:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098088576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788390558.503919:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.503977:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390558.504092:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098088576 00000100:00100000:2.0:1788390558.504101:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098088576 00000100:00100000:2.0:1788390558.504196:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788390558.504206:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:19528:x1875263098088576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788390558.504244:0:17201:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788390558.504248:0:17201:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788390558.504252:0:17201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788390558.504703:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:19528:x1875263098088576:12345-0@lo:253:mount.lustre.0 Request processed in 497us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390558.504712:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788390558.504804:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098088576:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788390558.504814:0:19528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788390558.504817:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788390558.504818:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788390558.504819:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390558.504820:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390558.504821:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390558.504822:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390558.504823:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390558.504824:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390558.504825:0:19528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788390558.504844:0:19528:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984fc19e1000 from lustre-OST0001 10000000:01000000:1.0:1788390558.504877:0:19528:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788390558.504880:0:19528:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788390558.504889:0:19528:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984fbac0cd28 local copy 00010000:00010000:1.0:1788390558.504900:0:19528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.505000:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098088704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390558.505049:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.505296:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390558.505382:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098088704 00000100:00100000:0.0:1788390558.505388:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098088704 00000100:00100000:0.0:1788390558.505417:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788390558.505425:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:19528:x1875263098088704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390558.505501:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:19528:x1875263098088704:12345-0@lo:501:mount.lustre.0 Request processed in 76us (451us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390558.505508:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788390558.505605:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098088704:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788390558.505617:0:19528:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788390558.505634:0:19528:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788390558.505641:0:19528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.505650:0:19528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e87ba1600/0xe156d0713be986c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be986ca expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390558.505674:0:19528:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984fc19e1000 10000000:01000000:1.0:1788390558.505679:0:19528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788390558.505684:0:19528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788390558.505686:0:19528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390558.505691:0:19528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788390558.505693:0:19528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788390558.505715:0:19528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5a00/0xe156d0713be98a74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.505723:0:19528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d5a00/0xe156d0713be98a74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.505731:0:19528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d5a00/0xe156d0713be98a74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.505744:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098088832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390558.505770:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.505807:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390558.505853:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098088832 00000100:00100000:0.0:1788390558.505858:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098088832 00000100:00100000:0.0:1788390558.505876:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788390558.505882:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:19528:x1875263098088832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390558.505890:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390558.505902:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4400/0xe156d0713be98a7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98a74 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390558.505925:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4400/0xe156d0713be98a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98a74 expref: 22 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390558.505935:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4400/0xe156d0713be98a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98a74 expref: 22 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390558.505945:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4400, rc 0) 00000100:00100000:0.0:1788390558.505983:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098088832:12345-0@lo:101:mount.lustre.0 Request processed in 101us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.505999:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788390558.506086:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098088832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390558.506098:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d5a00/0xe156d0713be98a74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98a7b expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.506108:0:19528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d5a00/0xe156d0713be98a74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98a7b expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390558.507029:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788390558.507683:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390558.509300:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788390558.509445:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788390558.509479:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788390558.509494:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788390558.509507:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788390558.509519:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788390558.509551:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788390558.509557:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788390558.509655:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098088960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390558.509724:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.509815:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390558.509906:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098088960 00000100:00100000:0.0:1788390558.509914:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098088960 00000100:00100000:2.0:1788390558.510015:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788390558.510031:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098088960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390558.510226:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098088960:12345-0@lo:501:mount.lustre.0 Request processed in 200us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390558.510237:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788390558.510447:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098088960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390558.510493:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390558.510560:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.511108:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f861910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390558.511171:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098089088 00000100:00100000:2.0:1788390558.511178:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098089088 00000100:00100000:2.0:1788390558.511229:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788390558.511239:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098089088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788390558.512120:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098089088:12345-0@lo:503:mount.lustre.0 Request processed in 881us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390558.512131:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788390558.512239:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390558.513065:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390558.513183:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390558.513239:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.513278:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f861910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390558.513404:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098089216 00000100:00100000:2.0:1788390558.513411:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098089216 00000100:00100000:0.0:1788390558.513628:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788390558.513642:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098089216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390558.514551:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098089216:12345-0@lo:502:mount.lustre.0 Request processed in 910us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.514560:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788390558.514713:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390558.514938:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788390558.514971:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788390558.514999:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788390558.515019:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788390558.515030:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788390558.515060:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788390558.515073:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788390558.515084:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788390558.515104:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788390558.515131:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390558.515173:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.515206:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390558.515228:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098089344 00000100:00100000:2.0:1788390558.515235:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098089344 00000100:00100000:2.0:1788390558.515279:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788390558.515289:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098089344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390558.515399:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098089344:12345-0@lo:502:mount.lustre.0 Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390558.515425:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788390558.515444:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390558.515482:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788390558.515491:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788390558.516107:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390558.516115:0:19532:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788390558.516121:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.516123:0:19532:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788390558.516128:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390558.516150:0:19532:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff984f9c6d99b8) 00000020:00000080:3.0:1788390558.516173:0:19532:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788390558.516179:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788390558.516249:0:19532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fc19e1000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788390558.516257:0:19532:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788390558.516269:0:19532:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe156d0713be98a89 00010000:00010000:3.0:1788390558.520790:0:19532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788390558.529943:0:19532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788390558.534276:0:19532:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788390558.537470:0:19532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788390558.537492:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390558.537498:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.537501:0:19532:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788390558.537504:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390558.537507:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.537509:0:19532:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788390558.537512:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390558.537514:0:19532:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788390558.537516:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390558.537518:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.537519:0:19532:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788390558.537521:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390558.537523:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.537525:0:19532:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788390558.537540:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788390558.537576:0:19532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390558.537580:0:19532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.537581:0:19532:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788390558.537584:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788390558.537737:0:19528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788390558.537765:0:19528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788390558.537787:0:19528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5a00/0xe156d0713be98a74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98a7b expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.537798:0:19528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d5a00/0xe156d0713be98a74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98a7b expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390558.537806:0:19528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fc19e1000 from 1 10000000:01000000:1.0:1788390558.537809:0:19528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390558.537847:0:19528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.537855:0:19528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.537867:0:19528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.537906:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390558.537975:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.538023:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788390558.538060:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098089472 00000100:00100000:2.0:1788390558.538068:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098089472 00000100:00100000:2.0:1788390558.538121:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788390558.538131:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:19528:x1875263098089472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390558.538144:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390558.538157:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98a90 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390558.538180:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98a90 expref: 23 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390558.538191:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98a90 expref: 23 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390558.538200:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1e00, rc 0) 00000100:00100000:2.0:1788390558.538252:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:19528:x1875263098089472:12345-0@lo:101:mount.lustre.0 Request processed in 121us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390558.538258:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788390558.539760:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390558.539784:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390558.539797:0:19528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390558.541985:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788390558.542265:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390558.542467:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788390558.542494:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788390558.542513:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788390558.542520:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788390558.542658:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390558.542738:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.542780:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390558.542915:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098089600 00000100:00100000:0.0:1788390558.542923:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098089600 00000100:00100000:0.0:1788390558.542975:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788390558.542984:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:19528:x1875263098089600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390558.543108:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:19528:x1875263098089600:12345-0@lo:501:mount.lustre.0 Request processed in 125us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.543115:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788390558.543240:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390558.543272:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089728:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390558.543311:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.543365:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390558.543494:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098089728 00000100:00100000:0.0:1788390558.543498:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098089728 00000100:00100000:0.0:1788390558.543594:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788390558.543603:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:19528:x1875263098089728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390558.543689:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:19528:x1875263098089728:12345-0@lo:503:mount.lustre.0 Request processed in 86us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390558.543732:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089728:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390558.544102:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390558.544157:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390558.544193:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.544210:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071840 going to sleep for 11 seconds 00000100:00100000:1.0:1788390558.547280:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098089856 00000100:00100000:1.0:1788390558.547294:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098089856 00000100:00100000:1.0:1788390558.547347:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788390558.547358:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098089856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390558.547538:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098089856:12345-0@lo:502:mount.lustre.0 Request processed in 183us (3343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390558.547546:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788390558.547640:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390558.549097:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000040:00080000:3.0:1788390558.550560:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788390558.550602:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788390558.550618:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788390558.550634:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788390558.550648:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788390558.550662:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788390558.550693:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788390558.550709:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788390558.550724:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788390558.550737:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788390558.550749:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788390558.550799:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390558.550881:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.551099:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071840 going to sleep for 11 seconds 00000100:00100000:0.0:1788390558.551270:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098089984 00000100:00100000:0.0:1788390558.551277:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098089984 00000100:00100000:1.0:1788390558.552550:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788390558.552749:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:19528:x1875263098089984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390558.552920:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:19528:x1875263098089984:12345-0@lo:502:mount.lustre.0 Request processed in 358us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390558.552929:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788390558.553154:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098089984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390558.553228:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788390558.553240:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788390558.554109:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390558.554119:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.554121:0:19536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788390558.554127:0:19536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fc19e1000 00000020:00000080:3.0:1788390558.554130:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788390558.554137:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390558.554140:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.554141:0:19536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788390558.554143:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390558.554145:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.554146:0:19536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788390558.554149:0:19536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984fc19e1000 00000020:00000080:3.0:1788390558.554152:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788390558.554210:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390558.554214:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.554215:0:19536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788390558.554217:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390558.554220:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.554221:0:19536:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788390558.554224:0:19536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fc19e1000 00000020:00000080:3.0:1788390558.554226:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788390558.554242:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390558.554245:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.554246:0:19536:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788390558.554248:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390558.554251:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.554252:0:19536:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788390558.554255:0:19536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984fc19e1000 00000020:00000080:3.0:1788390558.554257:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788390558.554289:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390558.554293:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390558.554294:0:19536:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788390558.554297:0:19536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788390558.556182:0:19528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788390558.556224:0:19528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390558.556249:0:19528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.556264:0:19528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390558.556348:0:19528:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788390558.556352:0:19528:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984fc19e1000 10000000:01000000:1.0:1788390558.556355:0:19528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984fc19e1000 10000000:01000000:1.0:1788390558.556360:0:19528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390558.556366:0:19528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984fc19e1000 from 1 10000000:01000000:1.0:1788390558.556368:0:19528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788390558.556404:0:19528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d4600/0xe156d0713be98a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.556413:0:19528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d4600/0xe156d0713be98a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.556424:0:19528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d4600/0xe156d0713be98a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.556464:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390558.556614:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.556656:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390558.556684:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098090112 00000100:00100000:1.0:1788390558.556690:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098090112 00000100:00100000:1.0:1788390558.556736:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788390558.556746:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:19528:x1875263098090112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390558.556758:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390558.556771:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d4000/0xe156d0713be98aa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98a9e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.556794:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4000/0xe156d0713be98aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98a9e expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.556805:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d4000/0xe156d0713be98aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98a9e expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.556815:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d4000, rc 0) 00000100:00100000:1.0:1788390558.556855:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090112:12345-0@lo:101:mount.lustre.0 Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390558.556862:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788390558.557657:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390558.557676:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d4600/0xe156d0713be98a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98aa5 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.557686:0:19528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d4600/0xe156d0713be98a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98aa5 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390558.560112:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788390558.560484:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390558.561463:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788390558.561497:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788390558.561512:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788390558.561525:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788390558.561558:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788390558.561572:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788390558.561592:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788390558.561605:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788390558.561618:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788390558.561630:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788390558.561642:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788390558.561656:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788390558.561671:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788390558.561684:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788390558.561698:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788390558.561713:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788390558.561727:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788390558.561743:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788390558.561755:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788390558.561769:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788390558.561783:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788390558.561797:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788390558.561809:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788390558.561823:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788390558.561840:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788390558.561852:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788390558.561866:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788390558.561880:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788390558.561916:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788390558.561943:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788390558.561958:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788390558.561973:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788390558.561999:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788390558.562016:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788390558.562027:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788390558.562050:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788390558.562062:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788390558.562073:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788390558.562083:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788390558.562094:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788390558.562104:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788390558.562115:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788390558.562127:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788390558.562138:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788390558.562149:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788390558.562160:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788390558.562178:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788390558.562182:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788390558.562272:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390558.562354:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.562389:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390558.563291:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098090240 00000100:00100000:0.0:1788390558.563307:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098090240 00000100:00100000:0.0:1788390558.563407:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788390558.563418:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390558.563580:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090240:12345-0@lo:501:mount.lustre.0 Request processed in 164us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.563589:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788390558.567744:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390558.567809:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390558.567888:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.567919:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390558.568077:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098090368 00000100:00100000:0.0:1788390558.568085:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098090368 00000100:00100000:0.0:1788390558.570128:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788390558.570148:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390558.570336:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090368:12345-0@lo:503:mount.lustre.0 Request processed in 181us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.570345:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788390558.571184:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090368:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788390558.572001:0:19528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788390558.572114:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390558.572193:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.572236:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098090496 00000100:00100000:1.0:1788390558.572242:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098090496 00000100:00100000:1.0:1788390558.572283:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788390558.572293:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390558.572417:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090496:12345-0@lo:502:mount.lustre.0 Request processed in 125us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390558.572425:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788390558.572471:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f88304cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390558.572486:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390558.572658:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788390558.572682:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788390558.572694:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788390558.572704:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788390558.572714:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788390558.572727:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788390558.572737:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788390558.572747:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788390558.572758:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788390558.572771:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788390558.572783:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788390558.572795:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788390558.572805:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788390558.572816:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788390558.572827:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788390558.572839:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788390558.572849:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788390558.572875:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788390558.572890:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788390558.572911:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788390558.572924:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788390558.572936:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788390558.572948:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788390558.572961:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788390558.572973:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788390558.572986:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788390558.572998:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788390558.573010:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788390558.573023:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788390558.573048:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788390558.573063:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788390558.573076:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788390558.573089:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788390558.573114:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788390558.573130:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788390558.573142:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788390558.573155:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788390558.573169:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788390558.573180:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788390558.573192:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788390558.573206:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788390558.573221:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788390558.573234:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788390558.573247:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788390558.573258:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788390558.573270:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788390558.573281:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788390558.573295:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788390558.573366:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390558.573415:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.573448:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098090624 00000100:00100000:1.0:1788390558.573459:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098090624 00000100:00100000:1.0:1788390558.573491:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788390558.573498:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390558.573580:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090624:12345-0@lo:502:mount.lustre.0 Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390558.573587:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788390558.573624:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390558.573638:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390558.573760:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788390558.573783:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788390558.573803:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390558.573838:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.573858:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098090752 00000100:00100000:1.0:1788390558.573862:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098090752 00000100:00100000:1.0:1788390558.573884:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788390558.573891:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390558.573949:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098090752:12345-0@lo:502:mount.lustre.0 Request processed in 58us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390558.573956:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788390558.573986:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982e9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390558.573998:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098090752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390558.574043:0:19528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788390558.574052:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788390558.582490:0:19540:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788390558.582510:0:19540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff984e8669cd28) 00000020:00000080:2.0:1788390558.583630:0:19540:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788390558.583758:0:19540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fc19e1000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788390558.583768:0:19540:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fc19e1000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788390558.583771:0:19540:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fc19e1000 3 00010000:00080000:2.0:1788390558.583807:0:19540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984e810c1000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.111@tcp at head 00010000:00010000:2.0:1788390558.585888:0:19540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788390558.587101:0:19540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788390558.587191:0:19540:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788390558.587208:0:19540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe156d0713be98ab3 00000100:00080000:0.0:1788390558.587220:0:19540:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390558.587226:0:19540:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff984e810c1000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390558.587262:0:19540:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e8884fb80 x1875263098090880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788390558.587292:0:19540:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788390558.587402:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098091008:0@lo:400:kworker.0 00000100:00100000:0.0:1788390558.587471:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788390558.587491:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390558.587497:0:18488:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788390558.587500:0:18488:0:(import.c:65:import_set_state_nolock()) ffff984e877d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390558.587506:0:18488:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 376 00000100:00080000:3.0:1788390558.587510:0:18488:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1788390558.587512:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788390558.587516:0:18488:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984e877d0800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:0.0:1788390558.587522:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098091136:0@lo:400:kworker.0 00000100:00100000:3.0:1788390558.587533:0:18488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adfb80 x1875263098091264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390558.587573:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390558.587576:0:18488:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788390558.587578:0:18488:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390558.587581:0:18488:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 376 00000100:00080000:3.0:1788390558.587583:0:18488:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788390558.587587:0:18488:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff984fc18fe800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:3.0:1788390558.587595:0:18488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e88adca80 x1875263098091776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390558.587643:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263098090880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788390558.587659:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263098091904:0@lo:400:kworker.0 00000100:00100000:1.0:1788390558.587694:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.587709:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098091392:0@lo:400:kworker.0 00000100:00100000:1.0:1788390558.587742:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098091264:0@lo:8:kworker.0 00000100:00100000:3.0:1788390558.587743:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.587768:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098092032:0@lo:400:kworker.0 00000100:00100000:1.0:1788390558.587791:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.587808:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.587818:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098091776:0@lo:8:kworker.0 00000100:00100000:3.0:1788390558.587848:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788390558.587855:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.587858:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098091520:0@lo:400:kworker.0 00000100:00100000:3.0:1788390558.587962:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.587984:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098092160:0@lo:400:kworker.0 00000100:00100000:1.0:1788390558.588007:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098090880 00000100:00100000:3.0:1788390558.588013:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.588016:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098090880 00000100:00100000:3.0:1788390558.588057:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.588057:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098091392 00000100:00100000:1.0:1788390558.588062:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098091392 00000100:00100000:3.0:1788390558.588074:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788390558.588082:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098091648:0@lo:400:kworker.0 00000100:00100000:1.0:1788390558.588092:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098092032 00000100:00100000:1.0:1788390558.588097:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098092032 00000100:00100000:0.0:1788390558.588119:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390558.588124:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098092160 00000100:00100000:1.0:1788390558.588128:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098091904 00000100:00100000:3.0:1788390558.588129:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098092160 00000100:00100000:1.0:1788390558.588133:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098091904 00000100:00100000:1.0:1788390558.588163:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788390558.588170:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098091008 00000100:00100000:3.0:1788390558.588171:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390558.588177:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098091392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390558.588182:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263098090880:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788390558.588183:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098091008 00010000:00080000:3.0:1788390558.588206:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000100:00100000:0.0:1788390558.588219:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098091520 00000100:00100000:0.0:1788390558.588225:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098091520 00000100:00100000:0.0:1788390558.588248:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000020:00000080:3.0:1788390558.588255:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe156d0713be98aba 00000100:00100000:0.0:1788390558.588257:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098091008:12345-0@lo:400:kworker.0 00000004:00100000:3.0:1788390558.588275:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788390558.588306:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098091008:12345-0@lo:400:kworker.0 Request processed in 50us (834us total) trans 0 rc 0/0 00000100:00080000:3.0:1788390558.588309:0:17211:0:(import.c:65:import_set_state_nolock()) ffff984e88ac4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390558.588318:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390558.588372:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390558.588381:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098091520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390558.588389:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875263098090880:12345-0@lo:38:llog_process_th.0 Request processed in 207us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.588416:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098091520:12345-0@lo:400:kworker.0 Request processed in 36us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.588424:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390558.588444:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098091264 00000100:00100000:0.0:1788390558.588448:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098091264 00000100:00100000:0.0:1788390558.588459:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098091776 00000100:00100000:0.0:1788390558.588461:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098091776 00000100:00100000:0.0:1788390558.588468:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098091136 00000100:00100000:0.0:1788390558.588470:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098091136 00000100:00100000:3.0:1788390558.588474:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390558.588504:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390558.588505:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788390558.588516:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098091136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390558.588521:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098092032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390558.588555:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098092032:12345-0@lo:400:kworker.0 Request processed in 41us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390558.588562:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390558.588573:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390558.588579:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263098091904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390558.588611:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875263098091904:12345-0@lo:400:kworker.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390558.588617:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390558.588628:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390558.588634:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098092160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390558.588660:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098092160:12345-0@lo:400:kworker.0 Request processed in 27us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390558.588666:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390558.588697:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788390558.588722:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e88aded80 x1875263098091904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390558.588735:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875263098091904:0@lo:400:kworker.0 00000100:00100000:3.0:1788390558.588763:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098091520:0@lo:400:kworker.0 00010000:00080000:3.0:1788390558.588773:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e88b22d80 x1875263098092160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390558.588781:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098092160:0@lo:400:kworker.0 00010000:00080000:3.0:1788390558.588791:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e88ade680 x1875263098091392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390558.588799:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875263098091392:0@lo:400:kworker.0 00010000:00080000:3.0:1788390558.588810:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e88b20700 x1875263098092032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390558.588820:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88b20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098092032:0@lo:400:kworker.0 00000100:00100000:1.0:1788390558.588822:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875263098091392:12345-0@lo:400:kworker.0 Request processed in 647us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390558.588832:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788390558.588857:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e8884fb80 x1875263098090880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390558.588859:0:18716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788390558.588868:0:18716:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788390558.588876:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390558.588886:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390558.588891:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390558.588894:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390558.589098:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098091136:12345-0@lo:400:kworker.0 Request processed in 584us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.589105:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390558.589117:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098091648 00000100:00100000:0.0:1788390558.589119:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098091648 00000100:00080000:1.0:1788390558.589147:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390558.589151:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390558.589158:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098091648:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788390558.589199:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00100000:0.0:1788390558.589200:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098091648:12345-0@lo:400:kworker.0 Request processed in 41us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.589209:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788390558.589210:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788390558.589216:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788390558.589220:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e810c1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788390558.589225:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390558.589228:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3621:1875263098090880:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788390558.589235:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1875263098091264:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788390558.589265:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098091648:0@lo:400:kworker.0 00000100:00100000:0.0:1788390558.589305:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1875263098091264:12345-0@lo:8:kworker.0 Request processed in 70us (1513us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788390558.589311:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788390558.589314:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788390558.589317:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e877d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390558.589347:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788390558.589351:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098091264:0@lo:8:kworker.0 00000100:00100000:0.0:1788390558.589354:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390558.589362:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1875263098091776:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788390558.589407:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3621:x1875263098091776:12345-0@lo:8:kworker.0 Request processed in 43us (1553us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788390558.589413:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390558.589431:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788390558.589436:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390558.589440:0:3621:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788390558.589444:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098091776:0@lo:8:kworker.0 00000100:00100000:0.0:1788390558.589456:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098091136:0@lo:400:kworker.0 00000100:00100000:0.0:1788390558.589470:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098091008:0@lo:400:kworker.0 00000020:01000004:0.0:1788390558.594548:0:19540:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788390558.594568:0:19540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff984f9c060000) 00000020:00000080:0.0:1788390558.594598:0:19540:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788390558.594706:0:19540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984fc19e1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788390558.594711:0:19540:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984fc19e1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788390558.594714:0:19540:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984fc19e1000 3 00010000:00080000:0.0:1788390558.594745:0:19540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984faab7b000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.111@tcp at head 00010000:00010000:1.0:1788390558.598975:0:19540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788390558.599226:0:19540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788390558.599287:0:19540:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788390558.599301:0:19540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe156d0713be98ac8 00000100:00080000:1.0:1788390558.599311:0:19540:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390558.599317:0:19540:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff984faab7b000 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:1.0:1788390558.601173:0:19540:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e883fd880 x1875263098092288/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390558.601218:0:19540:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788390558.602102:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1875263098092288:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788390558.602182:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390558.602235:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098092288 00000100:00100000:1.0:1788390558.602244:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098092288 00000100:00100000:1.0:1788390558.602290:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390558.602298:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3621:x1875263098092288:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788390558.602344:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:1.0:1788390558.602440:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe156d0713be98acf 00000004:00100000:1.0:1788390558.602457:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788390558.602493:0:17211:0:(import.c:65:import_set_state_nolock()) ffff984e81091800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390558.602616:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875263098092288:12345-0@lo:38:llog_process_th.0 Request processed in 318us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390558.602624:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1788390558.602727:0:19540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:2.0:1788390558.603120:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984e883fd880 x1875263098092288/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390558.603132:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788390558.603142:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788390558.603150:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788390558.603156:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788390558.603158:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984faab7b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788390558.603164:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3621:1875263098092288:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788390558.603223:0:19528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788390558.603253:0:19528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788390558.603274:0:19528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d4600/0xe156d0713be98a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98aa5 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390558.603297:0:19528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d4600/0xe156d0713be98a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98aa5 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788390558.603383:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788390558.603386:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390558.603387:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390558.603389:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390558.603390:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390558.603391:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390558.603393:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390558.603395:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390558.603396:0:19528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390558.603400:0:19528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788390558.603402:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390558.603404:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390558.603405:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390558.603407:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390558.603408:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390558.603409:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390558.603410:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390558.603411:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390558.603413:0:19528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390558.603431:0:19528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788390558.603445:0:19528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098092416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390558.603493:0:19528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390558.603526:0:19528:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f99d21840 going to sleep for 11 seconds 00000100:00100000:1.0:1788390558.603532:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098092416 00000100:00100000:1.0:1788390558.603538:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098092416 00000100:00100000:1.0:1788390558.603644:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788390558.603655:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098092416:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788390558.603677:0:17201:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788390558.603691:0:17201:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788390558.608844:0:17201:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788390558.608861:0:17201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788390558.608883:0:17225:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788390558.608890:0:17225:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788390558.608912:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.608930:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98986 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.608949:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98994 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.608957:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.608995:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be98994 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.609010:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be98994 expref: 24 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.609023:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098092544:0@lo:104: 00000100:00100000:1.0:1788390558.609096:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390558.609130:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:19528:x1875263098092416:12345-0@lo:253:mount.lustre.0 Request processed in 5475us (5632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390558.609142:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:1.0:1788390558.609149:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be98986 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.609160:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be98986 expref: 23 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.609169:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098092672:0@lo:104: 00000100:00100000:1.0:1788390558.609193:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390558.609208:0:19528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:19528:1875263098092416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788390558.609211:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb1abcc0 going to sleep for 11 seconds 10000000:01000000:0.0:1788390558.609229:0:19528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788390558.609233:0:19528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390558.609234:0:19528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390558.609236:0:19528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390558.609237:0:19528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390558.609238:0:19528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390558.609240:0:19528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390558.609241:0:19528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390558.609243:0:19528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390558.609244:0:19528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788390558.609258:0:19528:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788390558.609596:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098092544 00000100:00100000:2.0:1788390558.609603:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098092544 00000100:00100000:2.0:1788390558.609629:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098092672 00000100:00100000:2.0:1788390558.609632:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098092672 00000100:00100000:2.0:1788390558.609642:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390558.609650:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:17225:x1875263098092544:12345-0@lo:104: 00010000:00010000:2.0:1788390558.609663:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390558.609718:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390558.609724:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:17225:x1875263098092544:12345-0@lo:104: Request processed in 75us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390558.609731:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390558.609734:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ff800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098092544:0@lo:104: 00000100:00100000:2.0:1788390558.609758:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390558.609764:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098092672:12345-0@lo:104: 00010000:00010000:2.0:1788390558.609771:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390558.609811:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788390558.609814:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e86bd6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17225:1875263098092672:0@lo:104: 00000100:00100000:2.0:1788390558.609820:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:17225:x1875263098092672:12345-0@lo:104: Request processed in 53us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390558.609827:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788390558.609834:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.610417:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390558.610424:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.610433:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cfe00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:1.0:1788390558.610438:0:17964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.610447:0:17964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390558.610455:0:17964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390558.610461:0:17964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390558.610495:0:17964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.610502:0:17964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390558.610525:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.610532:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20cfe00/0xe156d0713be98994 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9899b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390558.610600:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390558.610603:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390558.610606:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390558.610608:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.610609:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390558.610617:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cf200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:3.0:1788390558.610622:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.610625:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098092800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390558.610631:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390558.610646:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390558.610651:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788390558.610666:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390558.610669:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390558.610675:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390558.610684:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390558.610691:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20cf200/0xe156d0713be98986 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be9898d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.610697:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788390558.610706:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390558.610706:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098092928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390558.610709:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390558.610712:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390558.610727:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390558.610756:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390558.610765:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098092800 00000100:00100000:1.0:1788390558.610770:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098092800 00010000:00010000:1.0:1788390558.610791:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98994 expref: 24 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.610820:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098092928 00000100:00100000:1.0:1788390558.610823:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098092928 00010000:00010000:1.0:1788390558.610834:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98986 expref: 25 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390558.610846:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390558.610852:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+25:3622:x1875263098092800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390558.610861:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390558.610951:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98994 expref: 25 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.610962:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be98994 expref: 25 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.610974:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a81c00/0xe156d0713be9899b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be98994 expref: 25 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.610986:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390558.611021:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3622:x1875263098092800:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390558.611028:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390558.611061:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390558.611067:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:3622:x1875263098092928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390558.611074:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390558.611078:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98986 expref: 23 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611087:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be98986 expref: 23 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611097:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e86a80000/0xe156d0713be9898d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be98986 expref: 23 pid: 17204 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611107:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611114:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788390558.611127:0:17196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007325423s 00010000:00010000:1.0:1788390558.611131:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611137:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611143:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611149:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611154:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4a00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390558.611164:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611171:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611184:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.611193:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390558.611214:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:3622:x1875263098092928:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390558.611220:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390558.611605:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098092928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390558.611616:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098092800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390558.614781:0:17225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.614800:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390558.614808:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d4a00/0xe156d0713be98ad6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788390558.622976:0:19528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788390558.625171:0:19528:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788390558.625179:0:19528:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788390558.625219:0:19528:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788390558.625255:0:19528:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788390558.625269:0:19528:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788390558.625283:0:19528:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788390558.625959:0:19528:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390558.626298:0:19528:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788390559.265959:0:19596:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788390559.266192:0:19596:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788390559.319553:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098093056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788390559.319627:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390559.319695:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098093056 00000100:00100000:0.0:1788390559.319705:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098093056 00000100:00100000:0.0:1788390559.319753:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390559.319764:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098093056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788390559.319793:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788390559.319922:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098093056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390559.319929:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788390559.319999:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098093056:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788390559.633578:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390559.827560:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390559.827586:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098093184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788390559.827668:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390559.827718:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098093184 00000100:00100000:1.0:1788390559.827726:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098093184 00000100:00100000:1.0:1788390559.827776:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390559.827786:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098093184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788390559.827818:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788390559.827872:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098093184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390559.827879:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390559.827942:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098093184:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788390560.274822:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788390560.657694:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788390560.657701:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984f85302000 from 10 10000000:01000000:1.0:1788390560.657705:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788390560.657747:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5600/0xe156d0713be98add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390560.657760:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984f846d5600/0xe156d0713be98add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390560.657772:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984f846d5600/0xe156d0713be98add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390560.657794:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098093312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390560.657853:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390560.657895:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f982de0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390560.658065:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098093312 00000100:00100000:0.0:1788390560.658073:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098093312 00000100:00100000:0.0:1788390560.658127:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788390560.658137:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:17206:x1875263098093312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390560.658160:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390560.658181:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4200/0xe156d0713be98ae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98add expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658203:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4200/0xe156d0713be98ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98add expref: 23 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658212:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4200/0xe156d0713be98ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98add expref: 23 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658230:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4200, rc 0) 00000100:00100000:0.0:1788390560.658269:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098093312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390560.658276:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788390560.658341:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098093312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390560.658355:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984f846d5600/0xe156d0713be98add lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98ae4 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658363:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984f846d5600/0xe156d0713be98add lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98ae4 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390560.658406:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098093440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788390560.658448:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390560.658467:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390560.658479:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098093440 00000100:00100000:0.0:1788390560.658483:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098093440 00000100:00100000:0.0:1788390560.658504:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390560.658510:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098093440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788390560.658528:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390560.658542:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390560.658545:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788390560.658613:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098093440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390560.658621:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390560.658650:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098093440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788390560.658703:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788390560.658710:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984f846d5600/0xe156d0713be98add lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98ae4 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658718:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984f846d5600/0xe156d0713be98add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98ae4 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390560.658727:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788390560.658729:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984fa27ae800 from 10 10000000:01000000:0.0:1788390560.658731:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788390560.658744:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be98aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658752:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be98aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658758:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be98aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390560.658770:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098093568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390560.658794:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390560.658813:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390560.658824:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098093568 00000100:00100000:0.0:1788390560.658827:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098093568 00000100:00100000:0.0:1788390560.658847:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788390560.658853:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098093568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390560.658859:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390560.658867:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b5600/0xe156d0713be98af2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98aeb expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658880:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b5600/0xe156d0713be98af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98aeb expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658888:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b5600/0xe156d0713be98af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98aeb expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658894:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5600, rc 0) 00000100:00100000:0.0:1788390560.658918:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:17206:x1875263098093568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390560.658924:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788390560.658952:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098093568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390560.658962:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be98aeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98af2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.658970:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be98aeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98af2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390560.659004:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098093696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788390560.659043:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390560.659064:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984e86a7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390560.659074:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098093696 00000100:00100000:0.0:1788390560.659077:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098093696 00000100:00100000:0.0:1788390560.659096:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788390560.659101:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb79b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:17206:x1875263098093696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788390560.659111:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390560.659120:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390560.659123:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788390560.659173:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb79b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:17206:x1875263098093696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390560.659179:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788390560.659206:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098093696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788390560.659232:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788390560.659236:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be98aeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98af2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390560.659240:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b4800/0xe156d0713be98aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98af2 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390560.660719:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390560.850607:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098093824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390560.850679:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390560.850734:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098093824 00000100:00100000:2.0:1788390560.850742:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098093824 00000100:00100000:2.0:1788390560.850795:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390560.850804:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098093824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390560.850827:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788390560.850869:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098093824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390560.850876:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788390560.850896:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390560.850936:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098093824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390561.362167:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098093952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788390561.362244:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390561.362359:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098093952 00000100:00100000:3.0:1788390561.362369:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098093952 00000100:00100000:3.0:1788390561.362429:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390561.362441:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098093952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788390561.362477:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788390561.362654:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875263098093952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 214us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390561.362669:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788390561.362758:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098093952:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788390561.681426:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788390562.414942:0:19885:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg211-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788390562.705521:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390562.899949:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788390562.982527:0:19937:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788390562.982919:0:19937:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1788390563.579772:0:19988:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788390563.580010:0:19988:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788390563.730058:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390563.760126:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390563.760187:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088602880 00000100:00100000:0.0:1788390563.760196:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088602880 00000100:00100000:3.0:1788390563.760710:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 110 00000100:00100000:3.0:1788390563.760720:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875263088602880:12345-192.168.202.11@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788390563.760747:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 90fb022f-9af8-4a30-a638-8170d305c354@192.168.202.11@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:3.0:1788390563.760780:0:17201:0:(genops.c:1385:class_connect()) connect: client 90fb022f-9af8-4a30-a638-8170d305c354, cookie 0xe156d0713be98af9 00000100:00080000:3.0:1788390563.760906:0:17201:0:(import.c:65:import_set_state_nolock()) ffff984e88ac0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390563.760966:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+5:2403:x1875263088602880:12345-192.168.202.11@tcp:250:mount.lustre.0 Request processed in 246us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390563.760978:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 110 00000100:00100000:3.0:1788390563.768955:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390563.769124:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088603008 00000100:00100000:1.0:1788390563.769134:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088603008 00000100:00100000:1.0:1788390563.769231:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 111 00000100:00100000:1.0:1788390563.769242:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+5:14916:x1875263088603008:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788390563.769269:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390563.769300:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5200/0xe156d0713be98b00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244143 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.769372:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5200/0xe156d0713be98b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244143 expref: 6 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.769384:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5200/0xe156d0713be98b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244143 expref: 6 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.769393:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5200, rc 0) 00000100:00100000:1.0:1788390563.769444:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+6:14916:x1875263088603008:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 205us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.769449:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 111 00000100:00100000:0.0:1788390563.771476:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390563.771565:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088603136 00000100:00100000:3.0:1788390563.771575:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088603136 00000100:00100000:3.0:1788390563.771641:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 112 00000100:00100000:3.0:1788390563.771650:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+6:14916:x1875263088603136:12345-192.168.202.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788390563.771829:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+6:14916:x1875263088603136:12345-192.168.202.11@tcp:501:mount.lustre.0 Request processed in 179us (360us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390563.771837:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 112 00000100:00100000:3.0:1788390563.776834:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390563.776946:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088603264 00000100:00100000:1.0:1788390563.776956:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088603264 00000100:00100000:1.0:1788390563.777026:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 113 00000100:00100000:1.0:1788390563.777037:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+6:14916:x1875263088603264:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788390563.777054:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390563.777072:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984f846d5000/0xe156d0713be98b07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24414a expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.777102:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984f846d5000/0xe156d0713be98b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24414a expref: 7 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.777114:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984f846d5000/0xe156d0713be98b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24414a expref: 7 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.777123:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984f846d5000, rc 0) 00000100:00100000:1.0:1788390563.777182:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+7:14916:x1875263088603264:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 147us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.777202:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 113 00000100:00100000:1.0:1788390563.779040:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390563.779134:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088603392 00000100:00100000:3.0:1788390563.779143:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088603392 00000100:00100000:3.0:1788390563.779250:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 114 00000100:00100000:3.0:1788390563.779262:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+7:14916:x1875263088603392:12345-192.168.202.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788390563.779485:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+8:14916:x1875263088603392:12345-192.168.202.11@tcp:501:mount.lustre.0 Request processed in 225us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390563.779492:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 114 00000100:00100000:0.0:1788390563.780791:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390563.780846:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088603520 00000100:00100000:1.0:1788390563.780853:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088603520 00000100:00100000:1.0:1788390563.780896:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 115 00000100:00100000:1.0:1788390563.780906:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+8:14916:x1875263088603520:12345-192.168.202.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788390563.781034:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+8:14916:x1875263088603520:12345-192.168.202.11@tcp:503:mount.lustre.0 Request processed in 129us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.781042:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 115 00000100:00100000:1.0:1788390563.782912:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390563.783205:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088603648 00000100:00100000:3.0:1788390563.783214:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088603648 00000100:00100000:3.0:1788390563.783282:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 116 00000100:00100000:3.0:1788390563.783289:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+8:14934:x1875263088603648:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390563.783436:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+8:14934:x1875263088603648:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 147us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390563.783441:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 116 00000100:00100000:3.0:1788390563.798648:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390563.798927:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088603776 00000100:00100000:2.0:1788390563.798939:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088603776 00000100:00100000:2.0:1788390563.799078:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 117 00000100:00100000:2.0:1788390563.799090:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+8:14934:x1875263088603776:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390563.799279:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+8:14934:x1875263088603776:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 190us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.799287:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 117 00000100:00100000:0.0:1788390563.802998:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390563.803090:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088603904 00000100:00100000:3.0:1788390563.803100:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088603904 00000100:00100000:3.0:1788390563.803171:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 118 00000100:00100000:3.0:1788390563.803182:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+8:14934:x1875263088603904:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390563.803379:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+8:14934:x1875263088603904:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 197us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390563.803387:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 118 00000100:00100000:3.0:1788390563.819384:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390563.819493:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088604032 00000100:00100000:2.0:1788390563.819506:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088604032 00000100:00100000:2.0:1788390563.819563:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 119 00000100:00100000:2.0:1788390563.819573:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+8:14916:x1875263088604032:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788390563.819589:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390563.819606:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e87ba1400/0xe156d0713be98b0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24417b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.819634:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e87ba1400/0xe156d0713be98b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24417b expref: 9 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.819645:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e87ba1400/0xe156d0713be98b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24417b expref: 9 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.819656:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e87ba1400, rc 0) 00000100:00100000:2.0:1788390563.819706:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+9:14916:x1875263088604032:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 133us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.819725:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 119 00000100:00100000:0.0:1788390563.823093:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390563.823436:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088604160 00000100:00100000:1.0:1788390563.823446:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088604160 00000100:00100000:1.0:1788390563.823506:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 120 00000100:00100000:1.0:1788390563.823515:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+9:14916:x1875263088604160:12345-192.168.202.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788390563.823538:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788390563.823559:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788390563.823563:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788390563.823566:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788390563.823569:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788390563.823572:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788390563.826204:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+9:14916:x1875263088604160:12345-192.168.202.11@tcp:256:mount.lustre.0 Request processed in 2678us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.826219:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 120 00000100:00100000:3.0:1788390563.831092:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390563.831348:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088604288 00000100:00100000:0.0:1788390563.831359:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088604288 00000100:00100000:0.0:1788390563.831438:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 121 00000100:00100000:0.0:1788390563.831448:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+9:14916:x1875263088604288:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390563.831464:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390563.831493:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244182 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.831523:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244182 expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.831534:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244182 expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.831544:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000100:00100000:0.0:1788390563.831623:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+10:14916:x1875263088604288:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 176us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390563.831630:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 121 00000100:00100000:0.0:1788390563.836054:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390563.840247:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088604416 00000100:00100000:1.0:1788390563.840263:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088604416 00000100:00100000:1.0:1788390563.840503:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 122 00000100:00100000:1.0:1788390563.841122:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+10:14916:x1875263088604416:12345-192.168.202.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788390563.841314:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+10:14916:x1875263088604416:12345-192.168.202.11@tcp:501:mount.lustre.0 Request processed in 786us (5270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.841357:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 122 00000100:00100000:3.0:1788390563.842772:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390563.842856:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088604544 00000100:00100000:2.0:1788390563.842876:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088604544 00000100:00100000:2.0:1788390563.842932:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 123 00000100:00100000:2.0:1788390563.842942:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+10:14916:x1875263088604544:12345-192.168.202.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788390563.843091:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+10:14916:x1875263088604544:12345-192.168.202.11@tcp:503:mount.lustre.0 Request processed in 149us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.843099:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 123 00000100:00100000:3.0:1788390563.846368:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390563.848216:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088604672 00000100:00100000:1.0:1788390563.848231:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088604672 00000100:00100000:1.0:1788390563.848304:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 124 00000100:00100000:1.0:1788390563.848316:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+10:14939:x1875263088604672:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390563.848528:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+10:14939:x1875263088604672:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 213us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.848537:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 124 00000100:00100000:3.0:1788390563.853245:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390563.853650:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088604800 00000100:00100000:0.0:1788390563.853662:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088604800 00000100:00100000:0.0:1788390563.853765:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 125 00000100:00100000:0.0:1788390563.853777:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f901bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+10:14939:x1875263088604800:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390563.853968:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f901bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+10:14939:x1875263088604800:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 192us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390563.853976:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 125 00000100:00100000:3.0:1788390563.865268:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390563.865380:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390563.865675:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088604928 00000100:00100000:0.0:1788390563.865686:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088604928 00000100:00100000:0.0:1788390563.865727:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088605184 00000100:00100000:0.0:1788390563.865737:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088605184 00000100:00100000:0.0:1788390563.865776:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:0.0:1788390563.865784:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875263088604928:12345-192.168.202.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788390563.865816:0:19242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79@192.168.202.11@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:0.0:1788390563.865866:0:19242:0:(genops.c:1385:class_connect()) connect: client 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79, cookie 0xe156d0713be98b1c 00000004:00100000:0.0:1788390563.865890:0:19242:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788390563.866116:0:19242:0:(import.c:65:import_set_state_nolock()) ffff984faab79800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390563.866197:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:2403:x1875263088604928:12345-192.168.202.11@tcp:38:mount.lustre.0 Request processed in 411us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390563.866205:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:0.0:1788390563.866233:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:0.0:1788390563.866239:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875263088605184:12345-192.168.202.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788390563.866255:0:19242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79@192.168.202.11@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:0.0:1788390563.866285:0:19242:0:(genops.c:1385:class_connect()) connect: client 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79, cookie 0xe156d0713be98b23 00000004:00100000:0.0:1788390563.866299:0:19242:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788390563.866460:0:19242:0:(import.c:65:import_set_state_nolock()) ffff984e85f71000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390563.866483:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:2403:x1875263088605184:12345-192.168.202.11@tcp:38:mount.lustre.0 Request processed in 243us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390563.867746:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:3.0:1788390563.870547:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390563.870590:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390563.870663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390563.870752:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088605312 00000100:00100000:1.0:1788390563.870764:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088605312 00000100:00100000:1.0:1788390563.870825:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088605056 00000100:00100000:1.0:1788390563.870828:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088605056 00000100:00100000:1.0:1788390563.870844:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088605440 00000100:00100000:1.0:1788390563.870847:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088605440 00000100:00100000:1.0:1788390563.870862:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:1.0:1788390563.870873:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:0:x1875263088605312:12345-192.168.202.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788390563.870911:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788390563.871006:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:0:x1875263088605312:12345-192.168.202.11@tcp:41:mount.lustre.0 Request processed in 134us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.871014:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:1.0:1788390563.871032:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:1.0:1788390563.871040:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:0:x1875263088605056:12345-192.168.202.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788390563.871075:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788390563.871115:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:0:x1875263088605056:12345-192.168.202.11@tcp:41:mount.lustre.0 Request processed in 76us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.871122:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:1.0:1788390563.871136:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:1.0:1788390563.871143:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:14916:x1875263088605440:12345-192.168.202.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788390563.871168:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788390563.871192:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:14916:x1875263088605440:12345-192.168.202.11@tcp:41:mount.lustre.0 Request processed in 49us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.871198:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00080000:3.0:1788390563.871647:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390563.871652:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390563.875503:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390563.875614:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088605568 00000100:00100000:1.0:1788390563.875626:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088605568 00000100:00100000:1.0:1788390563.875691:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:1.0:1788390563.875702:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:14916:x1875263088605568:12345-192.168.202.11@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788390563.875796:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:14916:x1875263088605568:12345-192.168.202.11@tcp:40:mount.lustre.0 Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.875804:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 12 00000100:00100000:3.0:1788390563.882683:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390563.882731:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390563.882773:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390563.883039:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088605952 00000100:00100000:0.0:1788390563.883049:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088605952 00000100:00100000:0.0:1788390563.883104:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:0.0:1788390563.883115:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:14916:x1875263088605952:12345-192.168.202.11@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788390563.883201:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:14916:x1875263088605952:12345-192.168.202.11@tcp:900:mount.lustre.0 Request processed in 87us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390563.883226:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:2.0:1788390563.883661:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088605696 00000100:00100000:2.0:1788390563.883667:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088605696 00000100:00100000:2.0:1788390563.883696:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088605824 00000100:00100000:2.0:1788390563.883699:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088605824 00000100:00100000:2.0:1788390563.883722:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:2.0:1788390563.883729:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875263088605696:12345-192.168.202.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788390563.883756:0:18716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79@192.168.202.11@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:2.0:1788390563.883785:0:18716:0:(genops.c:1385:class_connect()) connect: client 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79, cookie 0xe156d0713be98b2a 00002000:00100000:2.0:1788390563.883798:0:18716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79/ffff984e810c5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788390563.883815:0:18716:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788390563.883995:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 14 00000100:00100000:3.0:1788390563.884002:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1875263088605824:12345-192.168.202.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788390563.884019:0:18718:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79@192.168.202.11@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:3.0:1788390563.884036:0:18718:0:(genops.c:1385:class_connect()) connect: client 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79, cookie 0xe156d0713be98b31 00002000:00100000:3.0:1788390563.884041:0:18718:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79/ffff984e88ac0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788390563.884053:0:18718:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788390563.884207:0:18718:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788390563.884234:0:18718:0:(import.c:65:import_set_state_nolock()) ffff984e88ac5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390563.884276:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:2403:x1875263088605824:12345-192.168.202.11@tcp:8:mount.lustre.0 Request processed in 273us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390563.884283:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 14 00002000:00080000:2.0:1788390563.884512:0:18716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788390563.884529:0:18716:0:(import.c:65:import_set_state_nolock()) ffff984e810c0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390563.884566:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:2403:x1875263088605696:12345-192.168.202.11@tcp:8:mount.lustre.0 Request processed in 835us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.884573:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:0.0:1788390563.889546:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390563.889708:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088606080 00000100:00100000:2.0:1788390563.889718:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088606080 00000100:00100000:2.0:1788390563.889814:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:2.0:1788390563.889826:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:14916:x1875263088606080:12345-192.168.202.11@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788390563.896801:0:17212:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6665us 00000004:00200000:2.0:1788390563.916548:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788390563.916688:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:14916:x1875263088606080:12345-192.168.202.11@tcp:33:mount.lustre.0 Request processed in 26858us (27146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.916699:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00080000:2.0:1788390563.921901:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390563.921907:0:18488:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788390563.921911:0:18488:0:(import.c:65:import_set_state_nolock()) ffff984e877d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390563.921923:0:18488:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984e877d0800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390563.921946:0:18488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e8741b100 x1875263098094464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788390563.921994:0:18488:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390563.921998:0:18488:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788390563.922000:0:18488:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390563.922005:0:18488:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff984fc18fe800 using connection 192.168.202.111@tcp/0@lo 00000100:00100000:2.0:1788390563.922017:0:18488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984e87419c00 x1875263098094976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390563.922086:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098094336:0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.922156:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.922221:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098095104:0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.922252:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.922271:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098095616:0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.922291:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.922378:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788390563.922385:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098094592:0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.922408:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.922424:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098095232:0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.922447:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.922475:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098094464:0@lo:8:kworker.0 00000100:00100000:2.0:1788390563.922511:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.922526:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098094976:0@lo:8:kworker.0 00000100:00100000:2.0:1788390563.922545:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.922580:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098095104 00000100:00100000:2.0:1788390563.922588:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098095104 00000100:00100000:2.0:1788390563.922626:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098095616 00000100:00100000:2.0:1788390563.922629:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098095616 00000100:00100000:2.0:1788390563.922652:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098094592 00000100:00100000:2.0:1788390563.922655:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098094592 00000100:00100000:2.0:1788390563.922666:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098095232 00000100:00100000:2.0:1788390563.922669:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098095232 00000100:00100000:2.0:1788390563.922687:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788390563.922698:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098095104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.922754:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098095104:12345-0@lo:400:kworker.0 Request processed in 57us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.922762:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788390563.922781:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390563.922787:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098095616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.922815:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098095616:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.922822:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390563.922842:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390563.922848:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098094592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.922876:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098094592:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.922882:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390563.922894:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390563.922900:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098095232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.922926:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875263098095232:12345-0@lo:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.922932:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390563.922954:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098094336 00000100:00100000:2.0:1788390563.922957:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098094336 00000100:00100000:2.0:1788390563.922997:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098094464 00000100:00100000:2.0:1788390563.923001:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098094464 00000100:00100000:2.0:1788390563.923011:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098094976 00000100:00100000:2.0:1788390563.923014:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098094976 00000100:00100000:2.0:1788390563.923023:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390563.923030:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098094336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.923061:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098094336:12345-0@lo:400:kworker.0 Request processed in 32us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.923067:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390563.923080:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390563.923084:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1875263098094464:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788390563.923111:0:18716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:2.0:1788390563.923141:0:18716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe156d0713be98b38 00002000:00100000:2.0:1788390563.923155:0:18716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff984e810c6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788390563.923169:0:18716:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788390563.923172:0:18716:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788390563.923372:0:18716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788390563.923397:0:18716:0:(import.c:65:import_set_state_nolock()) ffff984e810c7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390563.923439:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875263098094464:12345-0@lo:8:kworker.0 Request processed in 353us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.923445:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390563.923459:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390563.923463:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3621:x1875263098094976:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788390563.923479:0:18716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:2.0:1788390563.923495:0:18716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe156d0713be98b3f 00002000:00100000:2.0:1788390563.923502:0:18716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff984e810c0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788390563.923506:0:18716:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788390563.923508:0:18716:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788390563.923532:0:18716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788390563.923544:0:18716:0:(import.c:65:import_set_state_nolock()) ffff984e810c1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390563.923572:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1875263098094976:12345-0@lo:8:kworker.0 Request processed in 107us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.923579:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788390563.923623:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741b100 x1875263098094464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788390563.923638:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788390563.923645:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788390563.923650:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788390563.923652:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984e877d0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788390563.923665:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788390563.923677:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3621:1875263098094464:0@lo:8:kworker.0 00010000:00080000:2.0:1788390563.923692:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87419c00 x1875263098094976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788390563.923702:0:3621:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788390563.923707:0:3621:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788390563.923710:0:3621:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788390563.923712:0:3621:0:(import.c:65:import_set_state_nolock()) ffff984fc18fe800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788390563.923725:0:3621:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788390563.923729:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3621:1875263098094976:0@lo:8:kworker.0 00000004:00080000:2.0:1788390563.923776:0:17236:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788390563.923793:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17236:1875263098095872:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788390563.923820:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.923837:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb784f6c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788390563.923852:0:17235:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788390563.923912:0:17235:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384481589740ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788390563.923918:0:17235:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788390563.923941:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098095744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390563.923966:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.924009:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098095744 00000100:00100000:2.0:1788390563.924014:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098095744 00000100:00100000:2.0:1788390563.924042:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788390563.924050:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098095744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390563.924063:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788390563.924097:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875263098095744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.924103:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788390563.924138:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e868c7b80 x1875263098095744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390563.924153:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3623:1875263098095744:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788390563.924179:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8741aa00 x1875263098094592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390563.924188:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098094592:0@lo:400:kworker.0 00010000:00080000:2.0:1788390563.924200:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e883ae300 x1875263098095232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390563.924207:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3622:1875263098095232:0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.924218:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098094336:0@lo:400:kworker.0 00010000:00080000:2.0:1788390563.924228:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e87419180 x1875263098095104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390563.924236:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098095104:0@lo:400:kworker.0 00010000:00080000:2.0:1788390563.924246:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e883aea00 x1875263098095616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390563.924254:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098095616:0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.924276:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098095872 00000100:00100000:2.0:1788390563.924279:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098095872 00000100:00100000:2.0:1788390563.924299:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788390563.924305:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17236:x1875263098095872:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788390563.924764:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098094080:0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.924803:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390563.924840:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098094720:0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.924866:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390563.924887:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098095360:0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.924920:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390563.924942:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788390563.924948:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8741a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098094208:0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.924970:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390563.925000:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098094848:0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.925020:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390563.925037:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1875263098095488:0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.925058:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390563.925084:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098095360 00000100:00100000:1.0:1788390563.925088:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098095360 00000100:00100000:1.0:1788390563.925120:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098095488 00000100:00100000:1.0:1788390563.925123:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098095488 00000100:00100000:1.0:1788390563.925140:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390563.925147:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098095360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.925185:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875263098095360:12345-0@lo:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.925192:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390563.925206:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390563.925212:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875263098095488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.925237:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875263098095488:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.925243:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390563.925259:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098094848 00000100:00100000:1.0:1788390563.925262:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098094848 00000100:00100000:1.0:1788390563.925281:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390563.925287:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098094848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.925346:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098094848:12345-0@lo:400:kworker.0 Request processed in 59us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.925353:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390563.925507:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098094720 00000100:00100000:1.0:1788390563.925512:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098094720 00000100:00100000:1.0:1788390563.925535:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098094208 00000100:00100000:1.0:1788390563.925538:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098094208 00000100:00100000:1.0:1788390563.925552:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788390563.925558:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098094720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.925592:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098094720:12345-0@lo:400:kworker.0 Request processed in 34us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.925598:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788390563.925611:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788390563.925618:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098094208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.925644:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098094208:12345-0@lo:400:kworker.0 Request processed in 27us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390563.925649:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788390563.925691:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098094208:0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.925703:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098094848:0@lo:400:kworker.0 00010000:00080000:1.0:1788390563.925714:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e883ad500 x1875263098095488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390563.925723:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3624:1875263098095488:0@lo:400:kworker.0 00000100:00100000:1.0:1788390563.925734:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8741b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098094720:0@lo:400:kworker.0 00010000:00080000:1.0:1788390563.925743:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e883ac380 x1875263098095360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390563.925761:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3624:1875263098095360:0@lo:400:kworker.0 00000004:00080000:3.0:1788390563.926778:0:17954:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788390563.926807:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb150a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1875263098096128:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788390563.926855:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390563.926879:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086900 going to sleep for 11 seconds 00000100:00080000:3.0:1788390563.926907:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390563.926911:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390563.926922:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390563.926926:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788390563.926936:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098096128 00000100:00100000:3.0:1788390563.926942:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098096128 00000100:00100000:3.0:1788390563.926998:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788390563.927006:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17954:x1875263098096128:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1788390563.927053:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390563.927161:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098096000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390563.927190:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788390563.927314:0:17953:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788390563.927408:0:17953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 384485085982ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788390563.927414:0:17953:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788390563.928080:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098096000 00000100:00100000:3.0:1788390563.928086:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098096000 00000100:00100000:3.0:1788390563.928125:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390563.928133:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1875263098096000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788390563.928148:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788390563.928213:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1875263098096000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390563.928220:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788390563.928260:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb151500 x1875263098096000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390563.928277:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098096000:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788390563.928731:0:17189:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:0.0:1788390563.928757:0:17189:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79 00000100:00100000:2.0:1788390563.929076:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098094080 00000100:00100000:2.0:1788390563.929082:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098094080 00000100:00100000:2.0:1788390563.929117:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788390563.929132:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e81a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3624:x1875263098094080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390563.929205:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e81a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3624:x1875263098094080:12345-0@lo:400:kworker.0 Request processed in 74us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.929212:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788390563.929288:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098094080:0@lo:400:kworker.0 00000004:00080000:1.0:1788390563.931454:0:17942:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000001:00100000:1.0:1788390563.931564:0:17942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79 00002000:00080000:3.0:1788390563.937693:0:18717:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788390563.937703:0:18717:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00002000:00080000:1.0:1788390563.937711:0:18716:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788390563.937720:0:18716:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788390563.937726:0:18716:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:3.0:1788390563.937812:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17954:x1875263098096128:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10801us (10952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390563.937823:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788390563.939708:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fbb150a80 x1875263098096128/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788390579 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390563.939726:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb150a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1875263098096128:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788390563.939739:0:17954:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788390563.939786:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1875263098096256:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788390563.939841:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390563.939882:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb249c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390563.940068:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098096256 00000100:00100000:3.0:1788390563.940076:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098096256 00000100:00100000:3.0:1788390563.940139:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788390563.940163:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17954:x1875263098096256:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788390563.940191:0:19543:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788390563.940247:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17954:x1875263098096256:12345-0@lo:5:osp-pre-1-1.0 Request processed in 86us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390563.940256:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788390563.940283:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e8884e680 x1875263098096256/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788390579 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390563.940294:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1875263098096256:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788390563.940303:0:17954:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788390563.940365:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1875263098096384:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788390563.940392:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.940416:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb784f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788390563.940663:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098096384 00000100:00100000:3.0:1788390563.940669:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098096384 00000100:00100000:3.0:1788390563.940704:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390563.940712:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17954:x1875263098096384:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788390563.940741:0:18717:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1788390563.946794:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.946808:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.946827:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.946832:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.946839:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.946871:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.946883:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.946906:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.946939:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390563.947025:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390563.947034:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.947045:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390563.947050:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.947060:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.947080:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.947087:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e88bbb71/0xe156d0713be98b46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.947121:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.947123:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.947125:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.947297:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.947304:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947314:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.947347:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.947353:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947364:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947373:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947381:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947396:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390563.947403:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390563.947408:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947421:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba0a00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390563.947424:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947433:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947444:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947451:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027f74cb8/0xe156d0713be98b4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947464:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390563.947467:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390563.947469:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.947788:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.947794:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947803:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.947806:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.947810:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947818:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947833:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947839:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.947861:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390563.947914:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390563.947922:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.947930:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390563.947934:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.947942:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.947968:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.947976:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006171c502/0xe156d0713be98b54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.948005:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.948007:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.948009:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.948265:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.948272:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948281:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.948284:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.948289:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948297:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948304:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948311:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948372:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788390563.948690:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.948696:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948705:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.948708:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.948712:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948722:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948731:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948739:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.948763:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788390563.948914:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390563.948920:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.948929:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e87ba1800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390563.948933:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.948942:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.948957:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.948964:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f7d9f0/0xe156d0713be98b5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949002:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390563.949005:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949013:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80000 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390563.949017:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949025:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949037:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.949042:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.949045:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949059:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.949061:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.949063:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390563.949442:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788390563.949449:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949458:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1788390563.949467:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390563.949472:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949482:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949490:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949498:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.949519:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390563.949749:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390563.949755:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.949763:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63ce00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390563.949767:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.949775:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.949787:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.949795:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7750ef5/0xe156d0713be98b69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.949823:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.949825:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.949827:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.950163:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.950170:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950180:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.950189:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.950194:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950204:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950212:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950218:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950241:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390563.950436:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390563.950442:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.950450:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390563.950454:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.950463:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.950475:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.950489:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000988606d1/0xe156d0713be98b70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.950504:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.950506:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.950508:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.950620:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.950626:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950635:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.950638:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.950642:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950652:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950660:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950673:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.950695:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390563.950855:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390563.950860:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.950868:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390563.950871:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.950880:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.950891:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.950910:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000052f9e79/0xe156d0713be98b77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.950925:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.950927:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.950929:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.951148:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.951154:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.951163:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.951166:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.951170:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.951179:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.951187:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.951195:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.951217:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390563.951366:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390563.951374:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.951382:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390563.951387:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.951395:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.951408:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.951416:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98b7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.951437:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.951441:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.951444:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.951445:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.951453:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.951467:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.951470:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.951474:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.951483:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.951491:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.951499:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.952166:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788390563.952577:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.952584:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.952595:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.952599:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.952604:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.952614:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.952632:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.952639:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955013:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788390563.955024:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390563.955035:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955048:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390563.955054:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955065:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955087:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955095:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98b85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955121:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390563.955125:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955141:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390563.955145:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955154:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955165:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955173:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98b8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955188:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.955190:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.955192:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.955383:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.955390:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955401:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.955406:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.955412:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955424:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955432:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955439:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955478:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390563.955580:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390563.955586:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955593:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80000 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390563.955596:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955604:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955621:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955629:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98b93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.955644:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.955646:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.955647:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.955812:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.955818:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955826:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.955829:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.955833:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955841:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955849:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955856:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.955865:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788390563.956382:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.956389:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956399:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.956407:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.956412:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956423:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956432:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956440:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956456:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788390563.956736:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390563.956742:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788390563.956749:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788390563.956750:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390563.956754:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956755:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956763:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1788390563.956764:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956766:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.956770:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956777:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956779:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956784:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f090a54/0xe156d0713be98b9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956799:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956812:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390563.956813:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956815:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956822:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390563.956825:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.956828:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390563.956832:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956842:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956850:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d52979e/0xe156d0713be98ba1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956862:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390563.956865:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956871:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735200 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:3.0:1788390563.956874:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956891:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956902:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956909:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e3bdf90/0xe156d0713be98ba8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.956922:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.956923:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.956925:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390563.956931:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788390563.957124:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788390563.957130:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.957139:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788390563.957142:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390563.957525:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.957539:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.957547:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.957554:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390563.957702:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390563.957856:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390563.957863:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.957876:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390563.957880:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.957888:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.957899:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.957906:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013317e01/0xe156d0713be98baf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.957922:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.957924:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.957926:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.958152:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.958190:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390563.958417:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390563.958425:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958442:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1788390563.958446:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390563.958451:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958462:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958471:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958478:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958504:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390563.958592:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390563.958599:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.958606:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390563.958610:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.958629:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.958641:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.958649:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033e0a24/0xe156d0713be98bb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.958664:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.958666:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.958668:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390563.958864:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390563.958870:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958878:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1788390563.958882:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390563.958886:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958895:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958916:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958922:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.958941:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390563.959167:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390563.959173:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959180:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390563.959184:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959191:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959202:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959218:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005f64240/0xe156d0713be98bbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959232:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.959233:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.959235:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390563.959436:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390563.959447:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.959456:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1788390563.959459:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390563.959463:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.959473:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.959489:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.959496:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.959522:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390563.959724:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390563.959730:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959739:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5200 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390563.959742:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959750:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959761:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959768:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d89deb9c/0xe156d0713be98bc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.959781:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.959782:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.959784:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788390563.963014:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788390563.963031:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.963048:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1788390563.963052:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390563.963059:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.963074:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.963085:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.963091:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.963114:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390563.963915:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390563.963925:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.963935:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390563.963940:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.963950:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.963968:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.963976:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035e8db86/0xe156d0713be98bcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.964009:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.964011:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.964013:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788390563.965178:0:19529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788390563.965213:0:19529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788390563.965217:0:19529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788390563.965229:0:19529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79 00000100:00100000:0.0:1788390563.965449:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17954:x1875263098096384:12345-0@lo:5:osp-pre-1-1.0 Request processed in 24734us (25052us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788390563.965460:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788390563.965554:0:17954:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788390563.965562:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17954:1875263098096384:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788390563.965577:0:17954:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788390563.965626:0:17954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17954:1875263098096512:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788390563.965660:0:17954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.965687:0:17954:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda3c0 going to sleep for 11 seconds 00002000:00010000:1.0:1788390563.965876:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390563.965885:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.965899:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788390563.965904:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390563.965910:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.965937:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.965947:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.965954:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.965971:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390563.966221:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390563.966228:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.966236:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4a00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390563.966240:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.966249:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.966264:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.966270:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000223bcb07/0xe156d0713be98bd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.966288:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390563.966290:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390563.966297:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390563.966361:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098096512 00000100:00100000:0.0:1788390563.966369:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098096512 00000100:00100000:0.0:1788390563.966416:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390563.966432:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17954:x1875263098096512:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788390563.966507:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17954:x1875263098096512:12345-0@lo:900:osp-pre-1-1.0 Request processed in 77us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390563.966514:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788390563.966653:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e868c7b80 x1875263098096512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788390579 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390563.966665:0:17954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17954:1875263098096512:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788390563.966883:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390563.966889:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.966899:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788390563.966902:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390563.966906:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.966917:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.966926:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.966944:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.966967:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788390563.967273:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390563.967279:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.967288:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788390563.967291:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390563.967295:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.967305:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.967312:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.967407:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390563.967412:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.967420:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390563.967424:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.967432:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.967445:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.967451:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbd2247c/0xe156d0713be98bd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.967466:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.967467:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.967469:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.967554:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.967603:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788390563.968086:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390563.968092:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.968106:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788390563.968109:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390563.968113:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.968123:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.968130:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.968136:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968168:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390563.968173:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968190:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390563.968193:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968202:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968213:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968219:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc1fb91b/0xe156d0713be98be0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968232:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390563.968235:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968241:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390563.968243:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968249:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968256:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.968268:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.968270:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.968272:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.968582:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788390563.968588:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ffb23aa/0xe156d0713be98be7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390563.968945:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390563.968951:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.968961:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788390563.968964:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390563.968968:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.969000:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.969009:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.969016:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.969047:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390563.969054:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.969062:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390563.969065:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.969073:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.969084:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.969092:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390563.969094:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390563.969095:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.969160:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788390563.969165:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042747cd6/0xe156d0713be98bee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390563.969586:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390563.969593:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.969600:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788390563.969603:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390563.969607:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.969616:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.969635:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.969641:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.969710:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390563.969715:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.969722:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80000 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390563.969725:0:17964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.969732:0:17964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390563.969743:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.969894:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788390563.969899:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0ae30e/0xe156d0713be98bf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.969917:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.969919:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390563.969937:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.969955:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390563.970242:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390563.970248:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.970256:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788390563.970258:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390563.970262:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.970271:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.970279:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.970292:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.970416:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788390563.970785:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788390563.970791:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.970800:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788390563.970803:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390563.970807:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.970817:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.970825:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390563.970832:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970867:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390563.970873:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970881:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80400 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390563.970885:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970903:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970918:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970926:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaa5d7/0xe156d0713be98bfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970941:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390563.970945:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970951:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80600 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390563.970954:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970961:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970972:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390563.970980:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390563.970982:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390563.971017:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390563.971144:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788390563.971150:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141ee31b/0xe156d0713be98c03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788390563.971214:0:18716:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1788390563.971318:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17236:x1875263098095872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 47008us (47492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390563.971456:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17236:1875263098095872:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788390563.971472:0:17236:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788390563.971535:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17236:1875263098096640:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788390563.971573:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390563.971658:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbaeda3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390563.971770:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390563.971810:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098096640 00000100:00100000:1.0:1788390563.971817:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098096640 00010000:00010000:0.0:1788390563.971938:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390563.971975:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390563.972001:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17236:x1875263098096640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788390563.972041:0:19543:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788390563.976732:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17236:x1875263098096640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4739us (5149us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788390563.976746:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788390563.977122:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17236:1875263098096640:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788390563.977141:0:17236:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:3.0:1788390564.072972:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390564.073153:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088606208 00000100:00100000:1.0:1788390564.073163:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088606208 00000100:00100000:1.0:1788390564.073229:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:1.0:1788390564.073238:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:14962:x1875263088606208:12345-192.168.202.11@tcp:101:mkdir.0 00010000:00010000:1.0:1788390564.073258:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390564.073351:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2441b3 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390564.073419:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98c11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390564.073433:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390564.073563:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390564.073619:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788390564.073623:0:17211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788390564.073658:0:17211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390564.073686:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441b3 expref: 7 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390564.073718:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98c11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441b3 expref: 6 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390564.073726:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984e86b2a800) 00010000:00010000:1.0:1788390564.073729:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390564.073733:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80000, rc 0) 00000100:00100000:1.0:1788390564.073905:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:14962:x1875263088606208:12345-192.168.202.11@tcp:101:mkdir.0 Request processed in 666us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390564.073914:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 13 00000100:00100000:3.0:1788390564.433829:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390564.433852:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098096768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788390564.433926:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390564.434044:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098096768 00000100:00100000:2.0:1788390564.434052:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098096768 00000100:00100000:2.0:1788390564.434111:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788390564.434120:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098096768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788390564.434144:0:17215:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788390564.434185:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098096768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390564.434191:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390564.434332:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098096768:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788390564.754011:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390564.945812:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098096896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788390564.945885:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390564.945989:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098096896 00000100:00100000:3.0:1788390564.945998:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098096896 00000100:00100000:3.0:1788390564.946062:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390564.946073:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098096896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390564.946100:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788390564.946158:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098096896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390564.946166:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390564.946226:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098096896:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788390565.777651:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390565.846363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390565.846468:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088606336 00000100:00100000:1.0:1788390565.846478:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088606336 00000100:00100000:1.0:1788390565.846559:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 14 00000100:00100000:1.0:1788390565.846572:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:15014:x1875263088606336:12345-192.168.202.11@tcp:41:lfs.0 00000004:00000024:1.0:1788390565.846617:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788390565.846722:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:15014:x1875263088606336:12345-192.168.202.11@tcp:41:lfs.0 Request processed in 153us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390565.846729:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 14 00000100:00080000:3.0:1788390565.846805:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390565.848628:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390565.848728:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088606464 00000100:00100000:2.0:1788390565.848740:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088606464 00000100:00100000:2.0:1788390565.848815:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:2.0:1788390565.848829:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:15014:x1875263088606464:12345-192.168.202.11@tcp:41:lfs.0 00000004:00000024:2.0:1788390565.848873:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788390565.848982:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:15014:x1875263088606464:12345-192.168.202.11@tcp:41:lfs.0 Request processed in 157us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390565.849006:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00080000:3.0:1788390565.849077:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390565.854027:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390565.854122:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088606592 00000100:00100000:3.0:1788390565.854135:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088606592 00000100:00100000:3.0:1788390565.854280:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:3.0:1788390565.854293:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:15014:x1875263088606592:12345-192.168.202.11@tcp:13:lfs.0 00002000:00000024:3.0:1788390565.854363:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788390565.854464:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:15014:x1875263088606592:12345-192.168.202.11@tcp:13:lfs.0 Request processed in 174us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390565.854471:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00080000:0.0:1788390565.856774:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390565.860878:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390565.861481:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088606720 00000100:00100000:1.0:1788390565.861492:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088606720 00000100:00100000:1.0:1788390565.866336:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:1.0:1788390565.866354:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:15014:x1875263088606720:12345-192.168.202.11@tcp:13:lfs.0 00002000:00000024:1.0:1788390565.866391:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788390565.866495:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:15014:x1875263088606720:12345-192.168.202.11@tcp:13:lfs.0 Request processed in 146us (5630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390565.866525:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00080000:0.0:1788390565.868198:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390565.969849:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390565.969874:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098097024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390565.969948:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390565.970097:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098097024 00000100:00100000:1.0:1788390565.970106:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098097024 00000100:00100000:1.0:1788390565.970186:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788390565.970198:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098097024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390565.970224:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788390565.970284:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098097024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390565.970293:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788390565.970371:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390565.970443:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098097024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390565.981453:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390565.984127:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088606848 00000100:00100000:0.0:1788390565.984144:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088606848 00000100:00100000:0.0:1788390565.984295:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 127 00000100:00100000:0.0:1788390565.984307:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e81a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+10:15046:x1875263088606848:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390565.984341:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390565.984361:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b5e00/0xe156d0713be98c18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2441ba expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390565.984394:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b5e00/0xe156d0713be98c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441ba expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390565.984406:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b5e00/0xe156d0713be98c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441ba expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390565.984417:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5e00, rc 0) 00000100:00100000:0.0:1788390565.984531:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e81a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+11:15046:x1875263088606848:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 226us (3090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390565.984538:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 127 00000100:00100000:2.0:1788390565.989347:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390565.989641:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088606976 00000100:00100000:1.0:1788390565.989652:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088606976 00000100:00100000:1.0:1788390565.989743:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 128 00000100:00100000:1.0:1788390565.989754:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+11:15046:x1875263088606976:12345-192.168.202.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788390565.989930:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+11:15046:x1875263088606976:12345-192.168.202.11@tcp:501:mount.lustre.0 Request processed in 177us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390565.989938:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 128 00000100:00100000:1.0:1788390565.996795:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390565.997085:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088607104 00000100:00100000:0.0:1788390565.997095:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088607104 00000100:00100000:0.0:1788390565.997202:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 129 00000100:00100000:0.0:1788390565.997212:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+11:15046:x1875263088607104:12345-192.168.202.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788390565.997405:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+11:15046:x1875263088607104:12345-192.168.202.11@tcp:503:mount.lustre.0 Request processed in 193us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390565.997419:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 129 00000100:00100000:3.0:1788390566.005918:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390566.006174:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088607232 00000100:00100000:1.0:1788390566.006185:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088607232 00000100:00100000:1.0:1788390566.006253:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 130 00000100:00100000:1.0:1788390566.006265:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+11:15053:x1875263088607232:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390566.007767:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+11:15053:x1875263088607232:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 1493us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390566.007960:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 130 00000100:00100000:3.0:1788390566.023748:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390566.023856:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088607360 00000100:00100000:0.0:1788390566.023866:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088607360 00000100:00100000:0.0:1788390566.023928:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 131 00000100:00100000:0.0:1788390566.023939:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+11:15053:x1875263088607360:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390566.024100:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+11:15053:x1875263088607360:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 161us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.024117:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 131 00000100:00100000:0.0:1788390566.028176:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390566.031173:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088607488 00000100:00100000:1.0:1788390566.031207:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088607488 00000100:00100000:1.0:1788390566.031283:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 132 00000100:00100000:1.0:1788390566.031295:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fb7b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+11:15053:x1875263088607488:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788390566.031498:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fb7b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+11:15053:x1875263088607488:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 205us (3331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390566.031507:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 132 00000100:00100000:3.0:1788390566.034943:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390566.035047:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088607616 00000100:00100000:2.0:1788390566.035056:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088607616 00000100:00100000:2.0:1788390566.035114:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 133 00000100:00100000:2.0:1788390566.035132:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+11:15046:x1875263088607616:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788390566.035151:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390566.035167:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf734a00/0xe156d0713be98c1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2441eb expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390566.035197:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf734a00/0xe156d0713be98c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441eb expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390566.035206:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf734a00/0xe156d0713be98c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441eb expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390566.035213:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf734a00, rc 0) 00000100:00100000:2.0:1788390566.035266:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+12:15046:x1875263088607616:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 145us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390566.035271:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 133 00000100:00100000:3.0:1788390566.041415:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390566.041494:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088607744 00000100:00100000:1.0:1788390566.041504:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088607744 00000100:00100000:1.0:1788390566.041569:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 134 00000100:00100000:1.0:1788390566.041580:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+12:15046:x1875263088607744:12345-192.168.202.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788390566.041605:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788390566.041697:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788390566.041703:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788390566.041706:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788390566.041710:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788390566.041712:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788390566.043256:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+12:15046:x1875263088607744:12345-192.168.202.11@tcp:256:mount.lustre.0 Request processed in 1669us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390566.043270:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 134 00000100:00100000:3.0:1788390566.046108:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390566.046251:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088607872 00000100:00100000:0.0:1788390566.046261:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088607872 00000100:00100000:0.0:1788390566.046380:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 135 00000100:00100000:0.0:1788390566.046389:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+12:15046:x1875263088607872:12345-192.168.202.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390566.046407:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390566.046424:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2441f2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390566.046451:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441f2 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390566.046472:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441f2 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390566.046482:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5800, rc 0) 00000100:00100000:0.0:1788390566.046536:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+13:15046:x1875263088607872:12345-192.168.202.11@tcp:101:mount.lustre.0 Request processed in 149us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.046560:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 135 00000100:00100000:3.0:1788390566.047878:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390566.047938:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088608000 00000100:00100000:2.0:1788390566.047954:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088608000 00000100:00100000:2.0:1788390566.048013:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 136 00000100:00100000:2.0:1788390566.048022:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+13:15046:x1875263088608000:12345-192.168.202.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788390566.048289:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+13:15046:x1875263088608000:12345-192.168.202.11@tcp:501:mount.lustre.0 Request processed in 267us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390566.048295:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 136 00000100:00100000:1.0:1788390566.049395:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390566.049550:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088608128 00000100:00100000:0.0:1788390566.049559:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088608128 00000100:00100000:0.0:1788390566.049646:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 137 00000100:00100000:0.0:1788390566.049655:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+13:15046:x1875263088608128:12345-192.168.202.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788390566.049779:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+13:15046:x1875263088608128:12345-192.168.202.11@tcp:503:mount.lustre.0 Request processed in 124us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.049787:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 137 00000100:00100000:3.0:1788390566.051695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390566.051794:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088608256 00000100:00100000:2.0:1788390566.051803:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088608256 00000100:00100000:2.0:1788390566.051860:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 138 00000100:00100000:2.0:1788390566.051869:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+13:15057:x1875263088608256:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390566.052021:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+13:15057:x1875263088608256:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 151us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390566.052029:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 138 00000100:00100000:3.0:1788390566.056882:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390566.057377:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088608384 00000100:00100000:0.0:1788390566.057388:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088608384 00000100:00100000:0.0:1788390566.057495:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 139 00000100:00100000:0.0:1788390566.057507:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+13:15057:x1875263088608384:12345-192.168.202.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390566.057668:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+13:15057:x1875263088608384:12345-192.168.202.11@tcp:502:llog_process_th.0 Request processed in 162us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.057676:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 139 00000100:00100000:1.0:1788390566.065978:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390566.066084:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390566.066179:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088608512 00000100:00100000:2.0:1788390566.066190:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088608512 00000100:00100000:2.0:1788390566.066237:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088608768 00000100:00100000:2.0:1788390566.066241:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088608768 00000100:00100000:2.0:1788390566.066269:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:2.0:1788390566.066278:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875263088608512:12345-192.168.202.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788390566.066311:0:17209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f61dd075-8549-4456-90c9-4c71677dd147@192.168.202.11@tcp t0 exp 0000000000000000 cur 386 last 0 00000100:00100000:0.0:1788390566.066355:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:0.0:1788390566.066362:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875263088608768:12345-192.168.202.11@tcp:38:mount.lustre.0 00000020:00000080:2.0:1788390566.066376:0:17209:0:(genops.c:1385:class_connect()) connect: client f61dd075-8549-4456-90c9-4c71677dd147, cookie 0xe156d0713be98c2d 00010000:00080000:0.0:1788390566.066379:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f61dd075-8549-4456-90c9-4c71677dd147@192.168.202.11@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:0.0:1788390566.066401:0:17211:0:(genops.c:1385:class_connect()) connect: client f61dd075-8549-4456-90c9-4c71677dd147, cookie 0xe156d0713be98c34 00000004:00100000:2.0:1788390566.066408:0:17209:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:0.0:1788390566.066414:0:17211:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788390566.066505:0:17209:0:(import.c:65:import_set_state_nolock()) ffff984e810c3800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788390566.066505:0:17211:0:(import.c:65:import_set_state_nolock()) ffff984e87881800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390566.066569:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+6:2403:x1875263088608768:12345-192.168.202.11@tcp:38:mount.lustre.0 Request processed in 206us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.066577:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:2.0:1788390566.066958:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f61dd075-8549-4456-90c9-4c71677dd147+6:2403:x1875263088608512:12345-192.168.202.11@tcp:38:mount.lustre.0 Request processed in 678us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390566.066976:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:3.0:1788390566.068766:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390566.070767:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390566.071052:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390566.071118:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088608896 00000100:00100000:0.0:1788390566.071525:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088608896 00000100:00100000:0.0:1788390566.071599:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088609024 00000100:00100000:0.0:1788390566.071603:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088609024 00000100:00100000:0.0:1788390566.071631:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:0.0:1788390566.071641:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f61dd075-8549-4456-90c9-4c71677dd147+6:0:x1875263088608896:12345-192.168.202.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390566.071677:0:19242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788390566.071765:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f61dd075-8549-4456-90c9-4c71677dd147+6:0:x1875263088608896:12345-192.168.202.11@tcp:41:mount.lustre.0 Request processed in 125us (3006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.071773:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:0.0:1788390566.071800:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:0.0:1788390566.071807:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f61dd075-8549-4456-90c9-4c71677dd147+6:15046:x1875263088609024:12345-192.168.202.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390566.071818:0:19242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788390566.071873:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f61dd075-8549-4456-90c9-4c71677dd147+6:15046:x1875263088609024:12345-192.168.202.11@tcp:41:mount.lustre.0 Request processed in 66us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.071880:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:0.0:1788390566.072748:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088608640 00000100:00100000:0.0:1788390566.072756:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088608640 00000100:00100000:0.0:1788390566.072795:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 20 00000100:00100000:0.0:1788390566.072804:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f61dd075-8549-4456-90c9-4c71677dd147+6:0:x1875263088608640:12345-192.168.202.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390566.072821:0:19242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788390566.072860:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f61dd075-8549-4456-90c9-4c71677dd147+6:0:x1875263088608640:12345-192.168.202.11@tcp:41:mount.lustre.0 Request processed in 57us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.072866:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 20 00000100:00080000:3.0:1788390566.074057:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390566.074066:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390566.074841:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390566.074955:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088609152 00000100:00100000:1.0:1788390566.074975:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088609152 00000100:00100000:1.0:1788390566.075069:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:1.0:1788390566.075079:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f61dd075-8549-4456-90c9-4c71677dd147+6:15046:x1875263088609152:12345-192.168.202.11@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788390566.075168:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f61dd075-8549-4456-90c9-4c71677dd147+6:15046:x1875263088609152:12345-192.168.202.11@tcp:40:mount.lustre.0 Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390566.075193:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:3.0:1788390566.077768:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390566.077809:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390566.077841:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390566.077914:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088609280 00000100:00100000:0.0:1788390566.077935:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088609280 00000100:00100000:0.0:1788390566.077986:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088609408 00000100:00100000:0.0:1788390566.077990:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088609408 00000100:00100000:1.0:1788390566.078005:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:1.0:1788390566.078061:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875263088609280:12345-192.168.202.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788390566.078095:0:18716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f61dd075-8549-4456-90c9-4c71677dd147@192.168.202.11@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:1.0:1788390566.078147:0:18716:0:(genops.c:1385:class_connect()) connect: client f61dd075-8549-4456-90c9-4c71677dd147, cookie 0xe156d0713be98c3b 00002000:00100000:1.0:1788390566.078160:0:18716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f61dd075-8549-4456-90c9-4c71677dd147/ffff984faaba6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788390566.078171:0:18716:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788390566.078239:0:18716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788390566.078268:0:18716:0:(import.c:65:import_set_state_nolock()) ffff984faaba4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390566.078362:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f61dd075-8549-4456-90c9-4c71677dd147+6:2403:x1875263088609280:12345-192.168.202.11@tcp:8:mount.lustre.0 Request processed in 301us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390566.078633:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088609536 00000100:00100000:2.0:1788390566.078638:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088609536 00000100:00100000:2.0:1788390566.078678:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 4 00000100:00100000:2.0:1788390566.078687:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f61dd075-8549-4456-90c9-4c71677dd147+6:15046:x1875263088609536:12345-192.168.202.11@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788390566.078728:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f61dd075-8549-4456-90c9-4c71677dd147+6:15046:x1875263088609536:12345-192.168.202.11@tcp:900:mount.lustre.0 Request processed in 42us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390566.078736:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 4 00000100:00100000:0.0:1788390566.079687:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00100000:0.0:1788390566.079700:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875263088609408:12345-192.168.202.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788390566.079733:0:18717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f61dd075-8549-4456-90c9-4c71677dd147@192.168.202.11@tcp t0 exp 0000000000000000 cur 386 last 0 00000100:00100000:1.0:1788390566.079739:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 22 00000020:00000080:0.0:1788390566.079782:0:18717:0:(genops.c:1385:class_connect()) connect: client f61dd075-8549-4456-90c9-4c71677dd147, cookie 0xe156d0713be98c42 00002000:00100000:0.0:1788390566.079794:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f61dd075-8549-4456-90c9-4c71677dd147/ffff984fb7a88800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390566.079803:0:18717:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390566.079874:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788390566.079901:0:18717:0:(import.c:65:import_set_state_nolock()) ffff984fb7a8b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390566.079944:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f61dd075-8549-4456-90c9-4c71677dd147+6:2403:x1875263088609408:12345-192.168.202.11@tcp:8:mount.lustre.0 Request processed in 245us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.079951:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00100000:2.0:1788390566.082457:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390566.082653:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088609664 00000100:00100000:1.0:1788390566.082663:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088609664 00000100:00100000:1.0:1788390566.082837:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 1 00000100:00100000:1.0:1788390566.082849:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f61dd075-8549-4456-90c9-4c71677dd147+6:15046:x1875263088609664:12345-192.168.202.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788390566.082961:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788390566.083056:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f61dd075-8549-4456-90c9-4c71677dd147+6:15046:x1875263088609664:12345-192.168.202.11@tcp:33:mount.lustre.0 Request processed in 208us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390566.083063:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 1 00000100:00100000:1.0:1788390566.212429:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390566.212581:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088609792 00000100:00100000:0.0:1788390566.212594:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088609792 00000100:00100000:0.0:1788390566.212712:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:0.0:1788390566.212724:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f61dd075-8549-4456-90c9-4c71677dd147+6:15080:x1875263088609792:12345-192.168.202.11@tcp:101:mkdir.0 00010000:00010000:0.0:1788390566.212745:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390566.212768:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4000/0xe156d0713be98c49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244223 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390566.212832:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390566.212846:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390566.212878:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390566.212928:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788390566.212932:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390566.212952:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390566.212986:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4000/0xe156d0713be98c49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244223 expref: 8 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390566.213009:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244223 expref: 7 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390566.213017:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984e86b2a800) 00010000:00010000:0.0:1788390566.213020:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390566.213023:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4e00, rc 0) 00000100:00100000:0.0:1788390566.213105:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f61dd075-8549-4456-90c9-4c71677dd147+7:15080:x1875263088609792:12345-192.168.202.11@tcp:101:mkdir.0 Request processed in 382us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390566.213113:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 22 00000100:00100000:3.0:1788390566.484387:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098097152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390566.484464:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390566.484580:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098097152 00000100:00100000:2.0:1788390566.484590:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098097152 00000100:00100000:2.0:1788390566.484644:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788390566.484654:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098097152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788390566.484689:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788390566.484744:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098097152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390566.484751:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390566.484872:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098097152:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788390566.803009:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390567.825503:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390568.150961:0:20085:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788390568.849768:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390569.041535:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390569.041567:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098097280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788390569.041663:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390569.043395:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098097280 00000100:00100000:3.0:1788390569.043409:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098097280 00000100:00100000:0.0:1788390569.043437:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098097408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390569.043491:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390569.043504:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098097280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788390569.043512:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788390569.043543:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788390569.043610:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098097280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390569.043621:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390569.043642:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098097408 00000100:00100000:3.0:1788390569.043648:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098097408 00000100:00100000:3.0:1788390569.043672:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390569.043680:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263098097408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390569.043694:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788390569.043713:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098097792:0@lo:400:kworker.0 00000100:00100000:3.0:1788390569.043726:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875263098097408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390569.043735:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390569.043750:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788390569.043755:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390569.043773:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098098304:0@lo:400:kworker.0 00000100:00100000:3.0:1788390569.043778:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098097792 00000100:00100000:3.0:1788390569.043783:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098097792 00000100:00100000:0.0:1788390569.043804:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390569.043826:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098098816:0@lo:400:kworker.0 00000100:00100000:3.0:1788390569.043829:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390569.043841:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098097792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.043857:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390569.043877:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788390569.043883:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098097664:0@lo:400:kworker.0 00000100:00100000:3.0:1788390569.043902:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098097792:12345-0@lo:400:kworker.0 Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390569.043911:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390569.043916:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788390569.043930:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390569.043962:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098098176:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.043988:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390569.043991:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098097280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788390569.044009:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263098098688:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.044037:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390569.044078:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098097792:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.044106:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098098304 00000100:00100000:0.0:1788390569.044110:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098098304 00000100:00100000:1.0:1788390569.044130:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098098816 00000100:00100000:1.0:1788390569.044142:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098098816 00000100:00100000:0.0:1788390569.044144:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098098688 00000100:00100000:0.0:1788390569.044149:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098098688 00000100:00100000:0.0:1788390569.044175:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788390569.044184:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098098304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390569.044186:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390569.044200:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263098098688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.044232:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875263098098304:12345-0@lo:400:kworker.0 Request processed in 48us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390569.044240:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788390569.044248:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875263098098688:12345-0@lo:400:kworker.0 Request processed in 51us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390569.044257:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390569.044266:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390569.044276:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098098816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390569.044283:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098098176 00000100:00100000:1.0:1788390569.044289:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098098176 00000100:00100000:0.0:1788390569.044341:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875263098098816:12345-0@lo:400:kworker.0 Request processed in 67us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390569.044350:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788390569.044355:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390569.044366:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098098176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.044382:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098097664 00000100:00100000:0.0:1788390569.044387:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098097664 00000100:00100000:1.0:1788390569.044404:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098098176:12345-0@lo:400:kworker.0 Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390569.044412:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390569.044420:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390569.044429:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098097664:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788390569.044436:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390569.044441:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390569.044444:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390569.044464:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098097664:12345-0@lo:400:kworker.0 Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390569.044471:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390569.044499:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3623:1875263098097536:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.044530:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390569.044564:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098098048:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.044588:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390569.044593:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098097536 00000100:00100000:1.0:1788390569.044598:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098097536 00000100:00100000:0.0:1788390569.044618:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098098560:0@lo:400:kworker.0 00000100:00100000:1.0:1788390569.044631:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788390569.044641:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3623:x1875263098097536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.044646:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390569.044668:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788390569.044675:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875263098097920:0@lo:400:kworker.0 00000100:00100000:1.0:1788390569.044687:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3623:x1875263098097536:12345-0@lo:400:kworker.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390569.044695:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788390569.044703:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390569.044724:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1875263098098432:0@lo:400:kworker.0 00000100:00100000:1.0:1788390569.044726:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098098560 00000100:00100000:1.0:1788390569.044732:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098098560 00000100:00100000:0.0:1788390569.044749:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390569.044770:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098097920 00000100:00100000:1.0:1788390569.044775:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098097920 00000100:00100000:0.0:1788390569.044776:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3623:1875263098097536:0@lo:400:kworker.0 00000100:00100000:1.0:1788390569.044794:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098098432 00000100:00100000:1.0:1788390569.044798:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098098432 00000100:00100000:0.0:1788390569.044806:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390569.044816:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098098560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390569.044832:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788390569.044841:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875263098097920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.044866:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875263098098560:12345-0@lo:400:kworker.0 Request processed in 51us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390569.044874:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788390569.044884:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875263098097920:12345-0@lo:400:kworker.0 Request processed in 43us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390569.044891:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788390569.045264:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098098048 00000100:00100000:3.0:1788390569.045269:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098098048 00000100:00100000:3.0:1788390569.045316:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390569.045348:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098098048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390569.045383:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098098048:12345-0@lo:400:kworker.0 Request processed in 38us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390569.045390:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788390569.045495:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875263098098432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.045528:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875263098098432:12345-0@lo:400:kworker.0 Request processed in 630us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390569.045754:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788390569.045776:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390569.045779:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788390569.045830:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788390569.045946:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098097408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390569.045983:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875263098097920:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.046000:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3623:1875263098098432:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.046015:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098098048:0@lo:400:kworker.0 00010000:00080000:0.0:1788390569.046029:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e883f8e00 x1875263098098560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390569.046039:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3623:1875263098098560:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.046072:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098097664:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.046094:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098098176:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.046106:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3625:1875263098098688:0@lo:400:kworker.0 00000100:00100000:0.0:1788390569.046119:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875263098098304:0@lo:400:kworker.0 00010000:00080000:0.0:1788390569.046129:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984e883f9500 x1875263098098816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390569.046151:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3625:1875263098098816:0@lo:400:kworker.0 00000100:00100000:1.0:1788390569.553647:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390569.553677:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098098944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788390569.553771:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390569.553893:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098098944 00000100:00100000:3.0:1788390569.553903:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098098944 00000100:00100000:3.0:1788390569.553979:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390569.553991:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098098944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788390569.554046:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788390569.554122:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098098944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390569.554133:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788390569.554251:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098098944:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788390569.556233:0:18712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f61dd075-8549-4456-90c9-4c71677dd147 00000001:00100000:2.0:1788390569.556246:0:18712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 329324d4-66cc-4fcf-a4fb-c56e5dbdbd79 00000001:00100000:1.0:1788390569.556972:0:19529:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f61dd075-8549-4456-90c9-4c71677dd147 00000001:00080000:1.0:1788390569.556991:0:19529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1788390569.875983:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390570.065717:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390570.065750:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098099072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390570.065839:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390570.065893:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098099072 00000100:00100000:0.0:1788390570.065904:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098099072 00000100:00100000:0.0:1788390570.065991:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390570.066005:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098099072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788390570.066045:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788390570.066116:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098099072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390570.066124:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390570.066170:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098099072:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788390570.515580:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1788390570.739731:0:20233:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc42ee3fe0 20000000:00000080:1.0:1788390570.739752:0:20233:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984fc1657400 uarg=0000000000000000 20000000:01000000:1.0:1788390570.739797:0:20233:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788390570.739803:0:20233:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788390570.739808:0:20233:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788390570.741550:0:20234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788390570.747577:0:20233:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788390570.762567:0:20233:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788390570.762727:0:20233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.762767:0:20233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be988e5 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.762775:0:20233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be988f3 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.762782:0:20233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98932 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.762789:0:20233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98a90 expref: 23 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.762798:0:20233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244182 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.762805:0:20233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441f2 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.762812:0:20233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.762860:0:20233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441f2 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.762877:0:20233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441f2 expref: 12 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.762893:0:20233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099200:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390570.764549:0:20233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244182 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.764579:0:20233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244182 expref: 12 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.764592:0:20233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099328:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390570.764661:0:20233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be98a90 expref: 23 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.764669:0:20233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be98a90 expref: 23 pid: 17202 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.764679:0:20233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099456:0@lo:104: 00000100:00100000:3.0:1788390570.764722:0:20233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390570.764814:0:20233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be98932 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.764822:0:20233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be98932 expref: 23 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.764830:0:20233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099584:0@lo:104: 00000100:00100000:3.0:1788390570.764851:0:20233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390570.774806:0:20233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be988f3 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.774958:0:20233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be988f3 expref: 23 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.774975:0:20233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099712:0@lo:104: 00000100:00100000:3.0:1788390570.775032:0:20233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390570.775177:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390570.775254:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390570.775285:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088609920 00000100:00100000:0.0:1788390570.775292:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088609920 00010000:00010000:0.0:1788390570.775339:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441f2 expref: 13 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390570.775367:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088610048 00000100:00100000:0.0:1788390570.775370:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088610048 00010000:00010000:0.0:1788390570.775383:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244182 expref: 14 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390570.775404:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:0.0:1788390570.775413:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90fb022f-9af8-4a30-a638-8170d305c354+14:2405:x1875263088609920:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390570.775429:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390570.775435:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441f2 expref: 14 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.775459:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441f2 expref: 14 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.775477:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390570.775521:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90fb022f-9af8-4a30-a638-8170d305c354+14:2405:x1875263088609920:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 109us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390570.775530:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:0.0:1788390570.775555:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:0.0:1788390570.775562:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90fb022f-9af8-4a30-a638-8170d305c354+13:2405:x1875263088610048:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390570.775569:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390570.775573:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244182 expref: 13 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.775581:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244182 expref: 13 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.775590:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390570.775607:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90fb022f-9af8-4a30-a638-8170d305c354+13:2405:x1875263088610048:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 47us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390570.775614:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:1.0:1788390570.777177:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098099456 00000100:00100000:1.0:1788390570.777188:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098099456 00000100:00100000:1.0:1788390570.777233:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098099584 00000100:00100000:1.0:1788390570.777236:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098099584 00000100:00100000:1.0:1788390570.777251:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390570.777259:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88ade680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:20233:x1875263098099456:12345-0@lo:104: 00010000:00010000:1.0:1788390570.777274:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390570.777384:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390570.777391:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88ade680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:20233:x1875263098099456:12345-0@lo:104: Request processed in 133us (12670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390570.777398:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390570.777415:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788390570.777517:0:17964:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390570.777524:0:17964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.777532:0:17964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5e00 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390570.777536:0:17964:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.777554:0:17964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390570.777561:0:17964:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390570.777567:0:17964:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390570.777603:0:17964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.777609:0:17964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390570.777630:0:17964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.777637:0:17964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984f846d5e00/0xe156d0713be98a90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98a97 expref: -99 pid: 19528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.777653:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390570.777655:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390570.777657:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390570.777678:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098099840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390570.777716:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390570.777755:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098099840 00000100:00100000:0.0:1788390570.777758:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098099840 00010000:00010000:0.0:1788390570.777775:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98a90 expref: 24 pid: 17202 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390570.777793:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390570.777799:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3624:x1875263098099840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390570.777814:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390570.777820:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98a90 expref: 24 pid: 17202 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.777830:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be98a90 expref: 24 pid: 17202 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.777844:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390570.777870:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3624:x1875263098099840:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390570.777877:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390570.777954:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3624:1875263098099840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390570.778011:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:20233:x1875263098099584:12345-0@lo:104: 00010000:00010000:1.0:1788390570.778020:0:17193:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390570.778063:0:17193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390570.778069:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88aded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:20233:x1875263098099584:12345-0@lo:104: Request processed in 63us (13217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390570.778075:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788390570.778186:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390570.778190:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.778197:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:0.0:1788390570.778200:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.778207:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390570.778212:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390570.778217:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390570.778245:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.778260:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390570.778274:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.778280:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984fc20ce200/0xe156d0713be98932 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be98939 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.778290:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390570.778292:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390570.778293:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390570.778302:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e883f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3625:1875263098099968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390570.778516:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390570.778547:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098099968 00000100:00100000:0.0:1788390570.778552:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098099968 00010000:00010000:0.0:1788390570.778567:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98932 expref: 24 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390570.778588:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390570.778595:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3625:x1875263098099968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390570.778604:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390570.778608:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be98932 expref: 24 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.778618:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be98932 expref: 24 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.778629:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390570.778655:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3625:x1875263098099968:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390570.778668:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390570.778698:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e883f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3625:1875263098099968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390570.780375:0:20233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe156d0713be988e5 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.780392:0:20233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe156d0713be988e5 expref: 23 pid: 17204 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.780406:0:20233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098100096:0@lo:104: 00000100:00100000:3.0:1788390570.780467:0:20233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390570.780486:0:20233:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec80c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788390570.780511:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b5800/0xe156d0713be98c26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441f2 expref: 12 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.780527:0:20233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099200:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390570.780539:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbb3b4c00/0xe156d0713be98b15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244182 expref: 11 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.780547:0:20233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099328:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390570.780557:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e87ba1e00/0xe156d0713be98a97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be98a90 expref: 23 pid: 17202 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.780566:0:20233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88add180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099456:0@lo:104: 00010000:00010000:3.0:1788390570.780575:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e87ba0600/0xe156d0713be98939 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be98932 expref: 22 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.780583:0:20233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e88adc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099584:0@lo:104: 00000100:00100000:2.0:1788390570.780711:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098099712 00000100:00100000:2.0:1788390570.780718:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098099712 00000100:00100000:2.0:1788390570.780755:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098100096 00000100:00100000:2.0:1788390570.780758:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098100096 00000100:00100000:2.0:1788390570.780773:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390570.780782:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:20233:x1875263098099712:12345-0@lo:104: 00010000:00010000:2.0:1788390570.780807:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.780874:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390570.780881:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+4:20233:x1875263098099712:12345-0@lo:104: Request processed in 100us (5849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390570.780888:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390570.780904:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390570.780911:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:20233:x1875263098100096:12345-0@lo:104: 00010000:00010000:2.0:1788390570.780917:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.780964:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788390570.780970:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+3:20233:x1875263098100096:12345-0@lo:104: Request processed in 60us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390570.780975:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788390570.780992:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390570.780997:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781004:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80800 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390570.781009:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781017:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390570.781025:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390570.781037:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788390570.781062:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781070:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390570.781117:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781124:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be988f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781135:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390570.781137:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781142:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81000 already unused, calling callback (ffffffffc13bec20) 10000000:00010000:2.0:1788390570.781145:0:17198:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781151:0:17198:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390570.781156:0:17198:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390570.781161:0:17198:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788390570.781173:0:17198:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781178:0:17198:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788390570.781191:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781197:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.111@tcp lock: ffff984e86a81000/0xe156d0713be988e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe156d0713be988ec expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781210:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390570.781212:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390570.781213:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390570.781225:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098100224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390570.781262:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390570.781288:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390570.781293:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098100352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390570.781315:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390570.781381:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098100224 00000100:00100000:2.0:1788390570.781386:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098100224 00010000:00010000:2.0:1788390570.781402:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be988f3 expref: 22 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390570.781816:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098100352 00000100:00100000:2.0:1788390570.781820:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098100352 00010000:00010000:2.0:1788390570.781834:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be988e5 expref: 23 pid: 17204 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390570.781847:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390570.781853:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f8604a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:3622:x1875263098100224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390570.781863:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390570.781868:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be988f3 expref: 23 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781890:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be988f3 expref: 23 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.781904:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390570.781951:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f8604a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:3622:x1875263098100224:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390570.781958:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390570.781995:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390570.782000:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:3622:x1875263098100352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390570.782006:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390570.782010:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe156d0713be988e5 expref: 22 pid: 17204 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.782019:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe156d0713be988e5 expref: 22 pid: 17204 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.782030:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.782037:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.782050:0:17194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.782058:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.782064:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.782076:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390570.782195:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390570.782261:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098100224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390570.782414:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63c200 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390570.783161:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.783175:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.783187:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390570.783201:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390570.783571:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984e87ba1000/0xe156d0713be988fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be988f3 expref: 22 pid: 17201 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.783587:0:20233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098099712:0@lo:104: 00010000:00010000:3.0:1788390570.783612:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984f846d5800/0xe156d0713be988ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe156d0713be988e5 expref: 21 pid: 17204 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390570.783620:0:20233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20233:1875263098100096:0@lo:104: 00010000:00010000:3.0:1788390570.783646:0:20233:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.783655:0:20233:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.783661:0:20233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390570.783666:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984fbf63c200/0xe156d0713be98c57 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390570.796833:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:3622:x1875263098100352:12345-0@lo:103:ldlm_bl.0 Request processed in 14826us (15510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390570.796848:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390570.796951:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098100352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390570.907570:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390571.089861:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098100480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390571.089970:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390571.090045:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098100480 00000100:00100000:2.0:1788390571.090053:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098100480 00000100:00100000:2.0:1788390571.090124:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788390571.090135:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098100480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390571.090159:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788390571.090230:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390571.091234:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098100480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1095us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390571.091246:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390571.091509:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098100480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390571.285766:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390571.285810:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390571.285886:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390571.285936:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390571.285996:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088610304 00000100:00100000:2.0:1788390571.286007:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088610304 00000100:00100000:2.0:1788390571.286075:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088610816 00000100:00100000:2.0:1788390571.286079:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088610816 00000100:00100000:2.0:1788390571.286104:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:2.0:1788390571.286113:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2404:x1875263088610304:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390571.286202:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2404:x1875263088610304:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 89us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390571.286210:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:2.0:1788390571.286228:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 36 00000100:00100000:2.0:1788390571.286234:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+6:2404:x1875263088610816:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390571.286255:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+6:2404:x1875263088610816:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390571.286260:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 36 00000100:00080000:2.0:1788390571.286735:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390571.291078:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088610560 00000100:00100000:1.0:1788390571.291095:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088610560 00000100:00100000:1.0:1788390571.291164:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088611072 00000100:00100000:0.0:1788390571.291165:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390571.291170:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088611072 00000100:00100000:0.0:1788390571.291191:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390571.291202:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088610432 00000100:00100000:1.0:1788390571.291207:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088610432 00000100:00100000:0.0:1788390571.291207:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390571.291235:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390571.291240:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:1.0:1788390571.291252:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2404:x1875263088610560:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390571.291259:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088610944 00000100:00100000:0.0:1788390571.291263:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088610944 00000100:00100000:0.0:1788390571.291286:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:0.0:1788390571.291292:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f61dd075-8549-4456-90c9-4c71677dd147+5:2404:x1875263088611072:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390571.291349:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f61dd075-8549-4456-90c9-4c71677dd147+5:2404:x1875263088611072:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 58us (5413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390571.291353:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:1.0:1788390571.291407:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2404:x1875263088610560:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 157us (5595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390571.291440:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:3.0:1788390571.291527:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:0.0:1788390571.291824:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:0.0:1788390571.291833:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f61dd075-8549-4456-90c9-4c71677dd147+5:2404:x1875263088610944:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390571.291875:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088610176 00000100:00100000:2.0:1788390571.291880:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088610176 00000100:00100000:2.0:1788390571.291915:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088610688 00000100:00100000:2.0:1788390571.291930:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088610688 00000100:00100000:2.0:1788390571.291955:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 37 00000100:00100000:2.0:1788390571.291963:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:2404:x1875263088610176:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390571.291993:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:2404:x1875263088610176:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 31us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390571.292001:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 37 00000100:00100000:2.0:1788390571.292017:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 38 00000100:00100000:2.0:1788390571.292024:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f61dd075-8549-4456-90c9-4c71677dd147+7:2404:x1875263088610688:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:2.0:1788390571.292049:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f61dd075-8549-4456-90c9-4c71677dd147+7:2404:x1875263088610688:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 26us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390571.292055:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 38 00000100:00080000:2.0:1788390571.292077:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390571.292082:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788390571.292093:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390571.292158:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2404:x1875263088610432:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:0.0:1788390571.292190:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f61dd075-8549-4456-90c9-4c71677dd147+5:2404:x1875263088610944:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 43us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390571.292191:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2404:x1875263088610432:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 656us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390571.292201:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:2.0:1788390571.294586:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:3.0:1788390571.602314:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390571.602356:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e8884e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098100608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788390571.602433:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390571.602487:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098100608 00000100:00100000:3.0:1788390571.602494:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098100608 00000100:00100000:3.0:1788390571.602535:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390571.602543:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098100608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788390571.602573:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788390571.602617:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098100608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390571.602624:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390571.603065:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e8884e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098100608:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788390571.606130:0:17189:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f61dd075-8549-4456-90c9-4c71677dd147 00000001:00100000:0.0:1788390571.606130:0:17942:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f61dd075-8549-4456-90c9-4c71677dd147 00010000:00010000:1.0:1788390571.934437:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390572.114313:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788390572.308363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390572.308480:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088611200 00000100:00100000:0.0:1788390572.308491:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088611200 00000100:00100000:0.0:1788390572.308549:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 141 00000100:00100000:0.0:1788390572.308559:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+11:14930:x1875263088611200:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390572.308576:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390572.308597:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4000/0xe156d0713be98c5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24422a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.308627:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4000/0xe156d0713be98c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24422a expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.308639:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4000/0xe156d0713be98c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24422a expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.308649:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4000, rc 0) 00000100:00100000:0.0:1788390572.308705:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+12:14930:x1875263088611200:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390572.308712:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 141 00000100:00100000:0.0:1788390572.318407:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390572.318505:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088611328 00000100:00100000:3.0:1788390572.318516:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088611328 00000100:00100000:3.0:1788390572.318573:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 142 00000100:00100000:3.0:1788390572.318585:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+12:14930:x1875263088611328:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390572.318736:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+12:14930:x1875263088611328:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 Request processed in 152us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390572.318745:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 142 00000100:00100000:0.0:1788390572.326514:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390572.328859:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088611456 00000100:00100000:1.0:1788390572.328874:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088611456 00000100:00100000:1.0:1788390572.328980:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 143 00000100:00100000:1.0:1788390572.328992:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+12:14930:x1875263088611456:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390572.329142:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+12:14930:x1875263088611456:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 Request processed in 152us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390572.329150:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 143 00000100:00100000:3.0:1788390572.338737:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390572.339032:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088611584 00000100:00100000:1.0:1788390572.339042:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088611584 00000100:00100000:1.0:1788390572.339101:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 144 00000100:00100000:1.0:1788390572.339111:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+12:14930:x1875263088611584:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390572.339128:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390572.339148:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984e86a81000/0xe156d0713be98c65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244231 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390572.339177:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984e86a81000/0xe156d0713be98c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244231 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390572.339189:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984e86a81000/0xe156d0713be98c65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244231 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390572.339199:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81000, rc 0) 00000100:00100000:1.0:1788390572.339256:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fb022f-9af8-4a30-a638-8170d305c354+13:14930:x1875263088611584:12345-192.168.202.11@tcp:101:ll_cfg_requeue.0 Request processed in 146us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390572.339274:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 144 00000100:00100000:0.0:1788390572.364574:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390572.365275:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088611712 00000100:00100000:1.0:1788390572.365287:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088611712 00000100:00100000:1.0:1788390572.365371:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 145 00000100:00100000:1.0:1788390572.365383:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+13:14930:x1875263088611712:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390572.365544:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+13:14930:x1875263088611712:12345-192.168.202.11@tcp:501:ll_cfg_requeue.0 Request processed in 161us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390572.365552:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 145 00000100:00100000:3.0:1788390572.372838:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390572.372873:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088611840 00000100:00100000:3.0:1788390572.372882:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088611840 00000100:00100000:3.0:1788390572.372947:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 146 00000100:00100000:3.0:1788390572.372959:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+13:14930:x1875263088611840:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390572.373120:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fb022f-9af8-4a30-a638-8170d305c354+13:14930:x1875263088611840:12345-192.168.202.11@tcp:503:ll_cfg_requeue.0 Request processed in 162us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390572.373130:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 146 10000000:01000000:1.0:1788390572.753953:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788390572.753961:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fc19e1000 from 13 10000000:01000000:1.0:1788390572.753967:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390572.754021:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be98c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390572.754033:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be98c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390572.754046:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be98c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390572.754074:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098100736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390572.754145:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390572.754669:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086900 going to sleep for 11 seconds 00000100:00100000:2.0:1788390572.763419:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098100736 00000100:00100000:2.0:1788390572.763435:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098100736 00000100:00100000:2.0:1788390572.763512:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788390572.763523:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+20:17206:x1875263098100736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390572.763540:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390572.763559:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf734e00/0xe156d0713be98c73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98c6c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.763586:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf734e00/0xe156d0713be98c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98c6c expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.763597:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf734e00/0xe156d0713be98c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98c6c expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.763605:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf734e00, rc 0) 00000100:00100000:2.0:1788390572.763755:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:17206:x1875263098100736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (9609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390572.763763:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788390572.771556:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098100736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390572.771588:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be98c6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c73 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390572.771621:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be98c6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98c73 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390572.771716:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098100864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390572.771781:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390572.771897:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390572.786284:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098100864 00000100:00100000:3.0:1788390572.786301:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098100864 00000100:00100000:3.0:1788390572.786392:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788390572.786403:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:17206:x1875263098100864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390572.786583:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:17206:x1875263098100864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (14802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390572.786592:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788390572.787096:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098100864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390572.787163:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098100992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390572.787216:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390572.787252:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fb6086900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390572.787503:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098100992 00000100:00100000:3.0:1788390572.787509:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098100992 00000100:00100000:3.0:1788390572.787553:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788390572.787562:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:17206:x1875263098100992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390572.787675:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:17206:x1875263098100992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390572.787682:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788390572.787770:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb21bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098100992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788390572.788835:0:20342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788390572.789170:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788390572.789194:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390572.789205:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be98c6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c73 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.789217:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984e86a80800/0xe156d0713be98c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c73 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390572.789227:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390572.789230:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984faaba1800 from 13 10000000:01000000:0.0:1788390572.789233:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390572.789267:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5400/0xe156d0713be98c7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.790213:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5400/0xe156d0713be98c7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.790227:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5400/0xe156d0713be98c7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390572.790259:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390572.790567:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390572.790607:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f98868a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390572.790687:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098101120 00000100:00100000:2.0:1788390572.790696:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098101120 00000100:00100000:2.0:1788390572.790749:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788390572.790758:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+21:17206:x1875263098101120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390572.790785:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390572.790800:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbf735a00/0xe156d0713be98c81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98c7a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.790824:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbf735a00/0xe156d0713be98c81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98c7a expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.790835:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbf735a00/0xe156d0713be98c81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98c7a expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.790844:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735a00, rc 0) 00000100:00100000:2.0:1788390572.790889:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:17206:x1875263098101120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390572.790895:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788390572.790994:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390572.791008:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5400/0xe156d0713be98c7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c81 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.791017:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5400/0xe156d0713be98c7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98c81 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390572.793356:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390572.793422:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390572.793460:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f98868a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390572.793538:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098101248 00000100:00100000:1.0:1788390572.793544:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098101248 00000100:00100000:1.0:1788390572.793588:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788390572.793596:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:17206:x1875263098101248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390572.793699:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:17206:x1875263098101248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390572.793706:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788390572.794142:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390572.794186:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390572.794231:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390572.794256:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f98868a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390572.794448:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098101376 00000100:00100000:1.0:1788390572.794453:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098101376 00000100:00100000:1.0:1788390572.794480:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788390572.794487:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:17206:x1875263098101376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390572.794568:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:17206:x1875263098101376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390572.794575:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788390572.794657:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788390572.799045:0:20343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788390572.806508:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788390572.806552:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390572.806565:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5400/0xe156d0713be98c7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c81 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.806577:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbb3b5400/0xe156d0713be98c7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c81 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390572.806590:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390572.806593:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984f85302000 from 13 10000000:01000000:2.0:1788390572.806596:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390572.806639:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be98c88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.806666:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be98c88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.806678:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be98c88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390572.806704:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390572.806772:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390572.806853:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390572.813566:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098101504 00000100:00100000:0.0:1788390572.813582:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098101504 00000100:00100000:0.0:1788390572.813645:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788390572.813655:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+22:17206:x1875263098101504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390572.813672:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390572.813689:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b4600/0xe156d0713be98c8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98c88 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.813719:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b4600/0xe156d0713be98c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98c88 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.813730:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b4600/0xe156d0713be98c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98c88 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.813740:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4600, rc 0) 00000100:00100000:0.0:1788390572.813820:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098101504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (7048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390572.813827:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788390572.814010:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390572.814031:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be98c88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c8f expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.814042:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be98c88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98c8f expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390572.814117:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390572.814169:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390572.814210:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390572.814222:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098101632 00000100:00100000:3.0:1788390572.814228:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098101632 00000100:00100000:3.0:1788390572.814278:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788390572.814286:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098101632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390572.814423:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098101632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390572.814431:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788390572.814570:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390572.814602:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390572.814639:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390572.814667:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390572.814725:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098101760 00000100:00100000:1.0:1788390572.814730:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098101760 00000100:00100000:1.0:1788390572.814770:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788390572.814777:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098101760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390572.814861:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098101760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390572.814869:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788390572.814957:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788390572.817209:0:20344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788390572.817569:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788390572.817609:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390572.817620:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be98c88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c8f expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.817631:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf735600/0xe156d0713be98c88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c8f expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390572.817642:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390572.817644:0:17206:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984fa27ae800 from 13 10000000:01000000:2.0:1788390572.817647:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390572.817680:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be98c96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.817688:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be98c96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.817699:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be98c96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390572.817721:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390572.817784:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390572.817827:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390572.817924:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098101888 00000100:00100000:0.0:1788390572.817931:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098101888 00000100:00100000:0.0:1788390572.817993:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788390572.818003:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+23:17206:x1875263098101888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390572.818015:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390572.818027:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984fbb3b5000/0xe156d0713be98c9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe156d0713be98c96 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.818049:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984fbb3b5000/0xe156d0713be98c9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe156d0713be98c96 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.818058:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984fbb3b5000/0xe156d0713be98c9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe156d0713be98c96 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.818067:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5000, rc 0) 00000100:00100000:0.0:1788390572.818107:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:17206:x1875263098101888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390572.818113:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788390572.818467:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098101888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390572.818481:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be98c96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c9d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390572.818490:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be98c96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe156d0713be98c9d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390572.818541:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098102016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390572.818577:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390572.818667:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390572.818771:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098102016 00000100:00100000:0.0:1788390572.818776:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098102016 00000100:00100000:0.0:1788390572.818808:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788390572.818816:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:17206:x1875263098102016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390572.818932:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:17206:x1875263098102016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390572.818939:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788390572.819433:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098102016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390572.819468:0:17206:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098102144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390572.819510:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390572.819540:0:17206:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390572.819993:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098102144 00000100:00100000:3.0:1788390572.819999:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098102144 00000100:00100000:3.0:1788390572.820040:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788390572.820050:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:17206:x1875263098102144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390572.820133:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:17206:x1875263098102144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390572.820140:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788390572.820445:0:17206:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:17206:1875263098102144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788390572.822534:0:20345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788390572.822714:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788390572.822735:0:17206:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390572.822745:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be98c96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c9d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.822768:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.111@tcp lock: ffff984fbf734200/0xe156d0713be98c96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe156d0713be98c9d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390572.945556:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390573.257139:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.257544:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088611968 00000100:00100000:2.0:1788390573.257559:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088611968 00000100:00100000:2.0:1788390573.257657:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00100000:2.0:1788390573.257671:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8884e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:15597:x1875263088611968:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390573.257698:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390573.257728:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98ca4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244238 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.257812:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.257828:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.257841:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.257856:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.257882:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.257888:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.257999:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734c00/0xe156d0713be98cb9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258008:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734c00/0xe156d0713be98cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258015:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734c00/0xe156d0713be98cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390573.258048:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788390573.258053:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390573.258098:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734c00/0xe156d0713be98cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258110:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258117:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258124:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258131:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390573.258136:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258152:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258166:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984e86b2a800) 00010000:00010000:2.0:1788390573.258170:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390573.258175:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258182:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98cab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258199:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258205:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258212:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258217:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390573.258220:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258226:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258233:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff984f87f00200) 00010000:00010000:2.0:1788390573.258236:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390573.258239:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258256:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98cb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258298:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98ca4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244238 expref: 8 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258313:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734c00/0xe156d0713be98cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244238 expref: 7 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.258626:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984f87f00400) 00010000:00010000:2.0:1788390573.258629:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390573.258632:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf734c00, rc 0) 00000100:00100000:2.0:1788390573.258760:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8884e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:15597:x1875263088611968:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 1091us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390573.258768:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 23 00000100:00080000:3.0:1788390573.258934:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390573.264483:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.267314:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088612096 00000100:00100000:2.0:1788390573.267352:0:17221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088612096 00000100:00100000:2.0:1788390573.268265:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:2.0:1788390573.268283:0:17221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:15597:x1875263088612096:12345-192.168.202.11@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788390573.268455:0:17221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:15597:x1875263088612096:12345-192.168.202.11@tcp:900:lhsmtool_posix.0 Request processed in 177us (4133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390573.268464:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:3.0:1788390573.273709:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390573.273921:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088612352 00000100:00100000:1.0:1788390573.273935:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088612352 00000100:00100000:1.0:1788390573.274015:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:1.0:1788390573.274028:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:15597:x1875263088612352:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390573.274057:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390573.274096:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cc0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24423f expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.274214:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.274233:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.274248:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.274442:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.274467:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.274498:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.274627:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98cd5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.274636:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.274645:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390573.274669:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788390573.275043:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275051:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275057:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275062:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390573.275067:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275073:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275087:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984f87f00400) 00010000:00010000:1.0:1788390573.275089:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390573.275100:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275106:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80c00/0xe156d0713be98cc7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275119:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275125:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275131:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275136:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a80600 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390573.275139:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275145:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275152:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff984e86b2a000) 00010000:00010000:1.0:1788390573.275155:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390573.275157:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.275162:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98cce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.276110:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cc0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24423f expref: 10 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.276142:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81400/0xe156d0713be98cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24423f expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.276151:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984e86b2af00) 00010000:00010000:1.0:1788390573.276154:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390573.276156:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81400, rc 0) 00000100:00100000:1.0:1788390573.276241:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:15597:x1875263088612352:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 2214us (2546us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788390573.276251:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:3.0:1788390573.278807:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390573.278912:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088612480 00000100:00100000:0.0:1788390573.278923:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088612480 00000100:00100000:0.0:1788390573.278978:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:0.0:1788390573.278987:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:15597:x1875263088612480:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788390573.279082:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:15597:x1875263088612480:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390573.279089:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:3.0:1788390573.286262:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390573.286486:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088612608 00000100:00100000:1.0:1788390573.286497:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088612608 00000100:00100000:1.0:1788390573.286617:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 26 00000100:00100000:1.0:1788390573.286629:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e88adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:15597:x1875263088612608:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788390573.287434:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788390573.287821:0:17210:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1127us 00000100:00100000:3.0:1788390573.297583:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.298579:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088612736 00000100:00100000:2.0:1788390573.298591:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088612736 00000100:00100000:3.0:1788390573.299126:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 27 00000100:00100000:3.0:1788390573.299138:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:15603:x1875263088612736:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390573.299159:0:19242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390573.299182:0:19242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be98ce3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244246 expref: -99 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299247:0:19242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299261:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299273:0:19242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299348:0:19242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299357:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299365:0:19242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299409:0:19242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299428:0:19242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299435:0:19242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299442:0:19242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63d000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390573.299446:0:19242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299454:0:19242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299468:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984e86b2a800) 00010000:00010000:3.0:1788390573.299471:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390573.299476:0:19242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299482:0:19242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98cea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299500:0:19242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299507:0:19242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299513:0:19242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299518:0:19242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63da00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390573.299528:0:19242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299533:0:19242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299539:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984fb7863a00) 00010000:00010000:3.0:1788390573.299540:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390573.299542:0:19242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299546:0:19242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98cf1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299576:0:19242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be98ce3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244246 expref: 10 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299590:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984e86b2a800) 00010000:00010000:3.0:1788390573.299593:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390573.299596:0:19242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be98ce3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244246 expref: 10 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.299604:0:19242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63c200, rc 0) 00000100:00100000:3.0:1788390573.300015:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:15603:x1875263088612736:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 872us (2432us total) trans 0 rc 301/301 00000100:00100000:3.0:1788390573.300023:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 27 00000100:00100000:3.0:1788390573.305120:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.311083:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088612864 00000100:00100000:3.0:1788390573.311099:0:17218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088612864 00000100:00100000:3.0:1788390573.311181:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:3.0:1788390573.311204:0:17218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:15603:x1875263088612864:12345-192.168.202.11@tcp:700:lfs.0 00000100:00100000:3.0:1788390573.311302:0:17218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:15603:x1875263088612864:12345-192.168.202.11@tcp:700:lfs.0 Request processed in 99us (6192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390573.311310:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:0.0:1788390573.318451:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e88adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:15597:x1875263088612608:12345-192.168.202.11@tcp:59:lhsmtool_posix.0 Request processed in 31805us (32182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390573.318469:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 26 00000100:00100000:3.0:1788390573.322640:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390573.322852:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088613120 00000100:00100000:1.0:1788390573.322868:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088613120 00000100:00100000:1.0:1788390573.322959:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:1.0:1788390573.322972:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:15603:x1875263088613120:12345-192.168.202.11@tcp:36:lfs.0 00010000:00010000:1.0:1788390573.323047:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390573.323086:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98c11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2441b3 expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.323109:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984e86b2a800) 00010000:00010000:1.0:1788390573.323116:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390573.323281:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.323625:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244223 expref: 5 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.323638:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.323686:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244223 expref: 5 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.323703:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244223 expref: 5 pid: 17209 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390573.323722:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb219f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1875263098102272:192.168.202.11@tcp:104: 00000100:00100000:1.0:1788390573.323839:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ec89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390573.335809:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390573.335897:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088613248 00000100:00100000:1.0:1788390573.335921:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088613248 00010000:00010000:1.0:1788390573.336012:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244223 expref: 6 pid: 17209 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390573.336077:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00100000:1.0:1788390573.336090:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f61dd075-8549-4456-90c9-4c71677dd147+6:2406:x1875263088613248:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390573.336108:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390573.336117:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244223 expref: 6 pid: 17209 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.336135:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244223 expref: 6 pid: 17209 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.336196:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984e86b2a800) 00010000:00010000:1.0:1788390573.336203:0:17196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.336216:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.336227:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.336252:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390573.336354:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f61dd075-8549-4456-90c9-4c71677dd147+6:2406:x1875263088613248:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 266us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390573.336362:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 15 00000100:00080000:3.0:1788390573.337161:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788390573.337667:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98c50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244223 expref: 5 pid: 17209 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390573.337706:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb219f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1875263098102272:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390573.337736:0:17211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.337746:0:17211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.337753:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.337783:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.337795:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.337806:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343647:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343670:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343682:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390573.343702:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008029c1c1 reply state 000000007a0f754f transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343727:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343735:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:2.0:1788390573.343738:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390573.343742:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788390573.343749:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788390573.343758:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343765:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343773:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343778:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390573.343783:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343791:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343802:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984e86b2a800) 00010000:00010000:2.0:1788390573.343804:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390573.343807:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343813:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98cf8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390573.343846:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008029c1c1 reply state 000000007a0f754f transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343855:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.343861:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984f87f00200) 00010000:00010000:2.0:1788390573.343863:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788390573.343866:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788390573.343967:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+10:15603:x1875263088613120:12345-192.168.202.11@tcp:36:lfs.0 Request processed in 20995us (21339us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788390573.343977:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:0.0:1788390573.427548:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.427948:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088613376 00000100:00100000:3.0:1788390573.427959:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088613376 00000100:00100000:3.0:1788390573.428056:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00100000:3.0:1788390573.428067:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+10:15611:x1875263088613376:12345-192.168.202.11@tcp:101:lctl.0 00010000:00010000:3.0:1788390573.428088:0:19242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390573.428109:0:19242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be98d0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24424d expref: -99 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.428183:0:19242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98d14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.428196:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98d14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.428206:0:19242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98d14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390573.428250:0:19242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788390573.428254:0:19242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390573.428290:0:19242:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98d14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.428313:0:19242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be98d0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24424d expref: 12 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.428366:0:19242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63da00/0xe156d0713be98d14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24424d expref: 11 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.428375:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863a00) 00010000:00010000:3.0:1788390573.428378:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390573.428381:0:19242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63da00, rc 0) 00000100:00100000:3.0:1788390573.428483:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+11:15611:x1875263088613376:12345-192.168.202.11@tcp:101:lctl.0 Request processed in 419us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390573.428491:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00100000:0.0:1788390573.462528:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.463473:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088613504 00000100:00100000:3.0:1788390573.463485:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088613504 00000100:00100000:3.0:1788390573.463611:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 30 00000100:00100000:3.0:1788390573.463623:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f61dd075-8549-4456-90c9-4c71677dd147+5:15612:x1875263088613504:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390573.463645:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390573.463664:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be98d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244254 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.463731:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98d22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.463744:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.463758:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390573.463803:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788390573.463832:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390573.463857:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.463884:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be98d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244254 expref: 7 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.463911:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63d000/0xe156d0713be98d22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244254 expref: 6 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.463920:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863a00) 00010000:00010000:3.0:1788390573.463924:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390573.463927:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63d000, rc 0) 00000100:00100000:3.0:1788390573.464052:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f61dd075-8549-4456-90c9-4c71677dd147+6:15612:x1875263088613504:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 431us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390573.464061:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 30 00000100:00100000:1.0:1788390573.469415:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390573.469490:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088613632 00000100:00100000:0.0:1788390573.469499:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088613632 00000100:00100000:0.0:1788390573.469543:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:0.0:1788390573.469550:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f61dd075-8549-4456-90c9-4c71677dd147+6:15612:x1875263088613632:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390573.469567:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390573.469584:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98d29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24425b expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469656:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469670:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469681:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469692:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469699:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469705:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469781:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98d3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469787:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98d3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469792:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98d3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390573.469831:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788390573.469834:0:17210:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390573.469858:0:17210:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98d3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469882:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469889:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469896:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469912:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390573.469918:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469926:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469938:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863a00) 00010000:00010000:0.0:1788390573.469944:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390573.469949:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469955:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469971:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469988:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.469993:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.470004:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390573.470008:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.470014:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.470022:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984f87f00200) 00010000:00010000:0.0:1788390573.470024:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390573.470027:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.470032:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.470061:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98d29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24425b expref: 8 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.470073:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98d3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24425b expref: 7 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.470079:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:0.0:1788390573.470082:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390573.470084:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4e00, rc 0) 00000100:00100000:0.0:1788390573.470159:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f61dd075-8549-4456-90c9-4c71677dd147+7:15612:x1875263088613632:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 607us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390573.470166:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 31 00000100:00100000:0.0:1788390573.473597:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.473751:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088613760 00000100:00100000:2.0:1788390573.473762:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088613760 00000100:00100000:2.0:1788390573.473831:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:2.0:1788390573.473839:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f61dd075-8549-4456-90c9-4c71677dd147+5:15612:x1875263088613760:12345-192.168.202.11@tcp:900:lfs.0 00000100:00100000:2.0:1788390573.473925:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f61dd075-8549-4456-90c9-4c71677dd147+5:15612:x1875263088613760:12345-192.168.202.11@tcp:900:lfs.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390573.473934:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00080000:3.0:1788390573.474147:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390573.476860:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.477119:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088614016 00000100:00100000:2.0:1788390573.477130:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088614016 00000100:00100000:2.0:1788390573.477252:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 32 00000100:00100000:2.0:1788390573.477264:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+7:15612:x1875263088614016:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390573.477285:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390573.477305:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98d45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244262 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390573.477462:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788390573.477557:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98d45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244262 expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.477571:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863a00) 00010000:00010000:2.0:1788390573.477574:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390573.477580:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98d45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244262 expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.477595:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735200, rc 0) 00000100:00100000:2.0:1788390573.477711:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+8:15612:x1875263088614016:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 448us (861us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788390573.477719:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 32 00000100:00100000:1.0:1788390573.484143:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390573.484484:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088614272 00000100:00100000:0.0:1788390573.484494:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088614272 00000100:00100000:0.0:1788390573.484582:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:0.0:1788390573.484592:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f61dd075-8549-4456-90c9-4c71677dd147+8:15612:x1875263088614272:12345-192.168.202.11@tcp:36:lfs.0 00010000:00010000:0.0:1788390573.484643:0:17210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390573.484669:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98d3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24425b expref: 8 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.484688:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:0.0:1788390573.484693:0:17210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390573.484713:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.484727:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.484737:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390573.484948:0:17210:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a58a83c reply state 0000000075581d0a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.484961:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.484967:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:0.0:1788390573.484971:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788390573.484973:0:17210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788390573.484991:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788390573.485066:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f61dd075-8549-4456-90c9-4c71677dd147+9:15612:x1875263088614272:12345-192.168.202.11@tcp:36:lfs.0 Request processed in 476us (933us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788390573.485089:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 33 00000100:00100000:2.0:1788390573.490425:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390573.495788:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088614528 00000100:00100000:1.0:1788390573.495803:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088614528 00000100:00100000:1.0:1788390573.495877:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:1.0:1788390573.495888:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f61dd075-8549-4456-90c9-4c71677dd147+9:15612:x1875263088614528:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:1.0:1788390573.496135:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f61dd075-8549-4456-90c9-4c71677dd147+10:15612:x1875263088614528:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 249us (5717us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788390573.496141:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:1.0:1788390573.501620:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.501760:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088614784 00000100:00100000:2.0:1788390573.501770:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088614784 00000100:00100000:2.0:1788390573.501828:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 34 00000100:00100000:2.0:1788390573.501839:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e86bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+10:15612:x1875263088614784:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:2.0:1788390573.501865:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390573.501884:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98d5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244269 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.501969:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.501982:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502007:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502020:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502029:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502035:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390573.502128:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788390573.502407:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502413:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502417:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502420:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735000 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390573.502424:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502428:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502439:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863a00) 00010000:00010000:2.0:1788390573.502441:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390573.502453:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502459:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502472:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502478:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502483:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502488:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390573.502491:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502497:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502505:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984f87f00200) 00010000:00010000:2.0:1788390573.502508:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390573.502510:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502515:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98d68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502550:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98d5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244269 expref: 12 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502571:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863a00) 00010000:00010000:2.0:1788390573.502573:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390573.502578:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98d5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244269 expref: 12 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.502588:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735200, rc 0) 00000100:00100000:2.0:1788390573.502644:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e86bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+11:15612:x1875263088614784:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 806us (1035us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788390573.502652:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 34 00000100:00100000:3.0:1788390573.505252:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390573.505378:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088614912 00000100:00100000:0.0:1788390573.505394:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088614912 00000100:00100000:0.0:1788390573.505463:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:0.0:1788390573.505474:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f61dd075-8549-4456-90c9-4c71677dd147+11:15612:x1875263088614912:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:0.0:1788390573.505498:0:19242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390573.505514:0:19242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d76 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244270 expref: -99 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.505588:0:19242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.505599:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.505607:0:19242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390573.505625:0:19242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788390573.505627:0:19242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788390573.505642:0:19242:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.505665:0:19242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98d76 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244270 expref: 13 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.505685:0:19242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244270 expref: 12 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.505711:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:0.0:1788390573.505714:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390573.505718:0:19242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:0.0:1788390573.505777:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f61dd075-8549-4456-90c9-4c71677dd147+12:15612:x1875263088614912:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 305us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390573.505784:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 35 00000100:00100000:0.0:1788390573.508583:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390573.508938:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088615040 00000100:00100000:1.0:1788390573.508948:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088615040 00000100:00100000:1.0:1788390573.509101:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:1.0:1788390573.509111:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f61dd075-8549-4456-90c9-4c71677dd147+12:15612:x1875263088615040:12345-192.168.202.11@tcp:37:lfs.0 00000100:00100000:3.0:1788390573.517836:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f61dd075-8549-4456-90c9-4c71677dd147+12:15612:x1875263088615040:12345-192.168.202.11@tcp:37:lfs.0 Request processed in 8709us (9244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390573.517861:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 3 00000100:00100000:3.0:1788390573.524123:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.524299:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088615296 00000100:00100000:2.0:1788390573.524314:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088615296 00000100:00100000:2.0:1788390573.524465:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 4 00000100:00100000:2.0:1788390573.524475:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e8793a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f61dd075-8549-4456-90c9-4c71677dd147+12:15612:x1875263088615296:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:2.0:1788390573.524757:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e8793a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f61dd075-8549-4456-90c9-4c71677dd147+13:15612:x1875263088615296:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 281us (645us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788390573.524764:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 4 00000100:00100000:2.0:1788390573.564561:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.564640:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088615424 00000100:00100000:3.0:1788390573.564649:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088615424 00000100:00100000:3.0:1788390573.564696:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 36 00000100:00100000:3.0:1788390573.564703:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+11:15618:x1875263088615424:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390573.564720:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390573.564736:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be98d84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244277 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.564797:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.564808:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.564816:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.564823:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.564828:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.564831:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.564894:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be98d99 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.564913:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be98d99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.564919:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be98d99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390573.564953:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788390573.564956:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390573.564988:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be98d99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565004:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565009:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565013:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565017:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63cc00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390573.565020:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565024:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565034:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863a00) 00010000:00010000:3.0:1788390573.565036:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390573.565039:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565042:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63cc00/0xe156d0713be98d8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565052:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565055:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565282:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565290:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf63c400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390573.565292:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565296:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565302:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984f87f00200) 00010000:00010000:3.0:1788390573.565304:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390573.565306:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565310:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c400/0xe156d0713be98d92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565483:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63c200/0xe156d0713be98d84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244277 expref: 13 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565494:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63dc00/0xe156d0713be98d99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244277 expref: 12 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.565499:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:3.0:1788390573.565500:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788390573.565502:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf63dc00, rc 0) 00000100:00100000:3.0:1788390573.565561:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+12:15618:x1875263088615424:12345-192.168.202.11@tcp:101:bash.0 Request processed in 857us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390573.565568:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 36 00000100:00100000:1.0:1788390573.569406:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.569480:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088615552 00000100:00100000:2.0:1788390573.569489:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088615552 00000100:00100000:2.0:1788390573.569533:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:2.0:1788390573.569539:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e883ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:15618:x1875263088615552:12345-192.168.202.11@tcp:900:bash.0 00000100:00100000:2.0:1788390573.569617:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e883ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:15618:x1875263088615552:12345-192.168.202.11@tcp:900:bash.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390573.569622:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:1.0:1788390573.571981:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.572037:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088615808 00000100:00100000:3.0:1788390573.572054:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088615808 00000100:00100000:3.0:1788390573.572099:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 37 00000100:00100000:3.0:1788390573.572105:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+12:15618:x1875263088615808:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:3.0:1788390573.572122:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390573.572138:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63ce00/0xe156d0713be98da0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24427e expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.572278:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.572290:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244270 expref: 12 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.572296:0:17210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.572384:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244270 expref: 12 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.572403:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244270 expref: 12 pid: 19242 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390573.572413:0:17210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1875263098102400:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390573.572501:0:17210:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071480 going to sleep for 11 seconds 00000100:00100000:3.0:1788390573.581225:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390573.582369:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088615936 00000100:00100000:1.0:1788390573.582384:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088615936 00010000:00010000:1.0:1788390573.582445:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244270 expref: 13 pid: 19242 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390573.582497:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:1.0:1788390573.582507:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f61dd075-8549-4456-90c9-4c71677dd147+13:2404:x1875263088615936:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390573.582523:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390573.582531:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244270 expref: 13 pid: 19242 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.582544:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244270 expref: 13 pid: 19242 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.582568:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:1.0:1788390573.582574:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.582584:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.582592:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390573.582612:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390573.582686:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f61dd075-8549-4456-90c9-4c71677dd147+13:2404:x1875263088615936:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 181us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390573.582694:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 16 00010000:00010000:0.0:1788390573.584072:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98d7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244270 expref: 12 pid: 19242 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390573.584096:0:17210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1875263098102400:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390573.584119:0:17210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.584130:0:17210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.584136:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.584162:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.584173:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.584183:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.585911:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.585930:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.585940:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390573.585952:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788390573.585979:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.585987:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.585994:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.586000:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390573.586005:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.586012:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.586024:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:0.0:1788390573.586028:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390573.586032:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.586054:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98da7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390573.586070:0:17210:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009086b4be reply state 000000009ca1962b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.586082:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.586088:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff984fbae70b00) 00010000:00010000:0.0:1788390573.586091:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788390573.586094:0:17210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788390573.586133:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf63ce00/0xe156d0713be98da0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24427e expref: 15 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.586149:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24427e expref: 14 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.586157:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:0.0:1788390573.586159:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788390573.586162:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4c00, rc 0) 00000040:00080000:2.0:1788390573.587063:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788390573.587520:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+15:15618:x1875263088615808:12345-192.168.202.11@tcp:101:bash.0 Request processed in 15410us (15540us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788390573.587529:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 37 00000100:00100000:3.0:1788390573.613110:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.613314:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088616064 00000100:00100000:2.0:1788390573.613364:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088616064 00000100:00100000:2.0:1788390573.613481:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 38 00000100:00100000:2.0:1788390573.613492:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+15:15618:x1875263088616064:12345-192.168.202.11@tcp:101:bash.0 00010000:00010000:2.0:1788390573.613517:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390573.613542:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98dc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244285 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.613631:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.613648:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.613661:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390573.613712:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788390573.613716:0:17211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390573.613735:0:17211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.613747:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.613773:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98dc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244285 expref: 17 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.613791:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244285 expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.613821:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:2.0:1788390573.613824:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390573.613828:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735000, rc 0) 00000100:00100000:2.0:1788390573.613893:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+16:15618:x1875263088616064:12345-192.168.202.11@tcp:101:bash.0 Request processed in 404us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390573.613911:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 38 00000100:00100000:1.0:1788390573.617265:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.617387:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088616320 00000100:00100000:3.0:1788390573.617397:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088616320 00000100:00100000:3.0:1788390573.617451:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:3.0:1788390573.617474:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+16:15618:x1875263088616320:12345-192.168.202.11@tcp:35:bash.0 00000100:00100000:3.0:1788390573.617801:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+17:15618:x1875263088616320:12345-192.168.202.11@tcp:35:bash.0 Request processed in 328us (544us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788390573.617809:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 5 00000100:00100000:0.0:1788390573.696065:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.696197:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088616576 00000100:00100000:3.0:1788390573.696207:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088616576 00000100:00100000:3.0:1788390573.696302:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:3.0:1788390573.696313:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+17:15628:x1875263088616576:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390573.696374:0:19242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390573.696396:0:19242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98dd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24428c expref: -99 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390573.696497:0:19242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788390573.696597:0:19242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98dd1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24428c expref: 19 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.696613:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984fb7863a00) 00010000:00010000:3.0:1788390573.696616:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390573.696622:0:19242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98dd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24428c expref: 19 pid: 19242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.696638:0:19242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfe00, rc 0) 00000100:00100000:3.0:1788390573.696689:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+18:15628:x1875263088616576:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 378us (633us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788390573.696697:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 39 00000100:00100000:1.0:1788390573.699316:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.699541:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088616832 00000100:00100000:3.0:1788390573.699563:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088616832 00000100:00100000:3.0:1788390573.699655:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:3.0:1788390573.699667:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+18:15628:x1875263088616832:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:3.0:1788390573.699990:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+19:15628:x1875263088616832:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 324us (680us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788390573.699999:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 6 00000100:00100000:1.0:1788390573.728236:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.728344:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088617088 00000100:00100000:3.0:1788390573.728355:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088617088 00000100:00100000:3.0:1788390573.728418:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00100000:3.0:1788390573.728429:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+19:15631:x1875263088617088:12345-192.168.202.11@tcp:101:lfs.0 00010000:00010000:3.0:1788390573.728454:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390573.728474:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98ddf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e244293 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.728585:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98de6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.728600:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.728612:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390573.728625:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788390573.728728:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98ddf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244293 expref: 22 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.728748:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98de6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244293 expref: 21 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.728776:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:3.0:1788390573.728781:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390573.728785:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf200, rc 0) 00000100:00100000:3.0:1788390573.728833:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+21:15631:x1875263088617088:12345-192.168.202.11@tcp:101:lfs.0 Request processed in 405us (606us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788390573.728840:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 40 00000100:00100000:1.0:1788390573.734396:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390573.734505:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088617216 00000100:00100000:0.0:1788390573.734516:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088617216 00000100:00100000:0.0:1788390573.734573:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 41 00000100:00100000:0.0:1788390573.734599:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+21:15631:x1875263088617216:12345-192.168.202.11@tcp:54:lfs.0 00010000:00010000:0.0:1788390573.734669:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.734686:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.734698:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.734734:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.734741:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.734748:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.734755:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390573.734759:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.734767:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.734779:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:0.0:1788390573.734782:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390573.734788:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.734794:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98df4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390573.734887:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+21:15631:x1875263088617216:12345-192.168.202.11@tcp:54:lfs.0 Request processed in 290us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390573.734903:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 41 00000100:00100000:1.0:1788390573.738427:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390573.738465:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390573.738569:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088617344 00000100:00100000:0.0:1788390573.738578:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088617344 00000100:00100000:0.0:1788390573.738637:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:0.0:1788390573.738648:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+21:2404:x1875263088617344:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390573.738663:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390573.738687:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98de6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244293 expref: 21 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390573.738709:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:0.0:1788390573.738714:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390573.738781:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+20:2404:x1875263088617344:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 134us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390573.738789:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:2.0:1788390573.738869:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088617600 00000100:00100000:2.0:1788390573.738874:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088617600 00000100:00100000:2.0:1788390573.738922:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:2.0:1788390573.738930:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+20:15631:x1875263088617600:12345-192.168.202.11@tcp:35:lfs.0 00000100:00100000:2.0:1788390573.739111:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+21:15631:x1875263088617600:12345-192.168.202.11@tcp:35:lfs.0 Request processed in 182us (645us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788390573.739118:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 7 00000100:00100000:1.0:1788390573.941592:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390573.941709:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088617856 00000100:00100000:3.0:1788390573.941717:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088617856 00000100:00100000:3.0:1788390573.941769:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 42 00000100:00100000:3.0:1788390573.941779:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+21:15662:x1875263088617856:12345-192.168.202.11@tcp:101:cat.0 00010000:00010000:3.0:1788390573.941804:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390573.941825:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98dfb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e24429a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.941964:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98e02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.941976:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98e02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.941985:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98e02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390573.941994:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788390573.942115:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98dfb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24429a expref: 24 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.942147:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98e02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24429a expref: 23 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390573.942156:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:3.0:1788390573.942159:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390573.942163:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfe00, rc 0) 00000100:00100000:3.0:1788390573.942262:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+23:15662:x1875263088617856:12345-192.168.202.11@tcp:101:cat.0 Request processed in 483us (676us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788390573.942269:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 42 00000100:00100000:3.0:1788390573.951513:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.951738:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088617984 00000100:00100000:2.0:1788390573.951748:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088617984 00000100:00100000:2.0:1788390573.951866:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 1 00000100:00100000:2.0:1788390573.951886:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+23:2405:x1875263088617984:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390573.951915:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390573.951939:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98e02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24429a expref: 23 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390573.951958:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:2.0:1788390573.951963:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390573.952025:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+22:2405:x1875263088617984:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 141us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390573.952051:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 1 00000100:00100000:1.0:1788390573.955495:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390573.955534:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088618240 00000100:00100000:2.0:1788390573.955545:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088618240 00000100:00100000:2.0:1788390573.955604:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 8 00000100:00100000:2.0:1788390573.955614:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+22:15662:x1875263088618240:12345-192.168.202.11@tcp:35:cat.0 00000100:00100000:2.0:1788390573.955935:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+23:15662:x1875263088618240:12345-192.168.202.11@tcp:35:cat.0 Request processed in 321us (451us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788390573.955944:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 8 00010000:00010000:0.0:1788390573.970259:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390574.014062:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.014165:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088618496 00000100:00100000:0.0:1788390574.014175:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088618496 00000100:00100000:0.0:1788390574.014238:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 43 00000100:00100000:0.0:1788390574.014249:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+23:15667:x1875263088618496:12345-192.168.202.11@tcp:101:dd.0 00010000:00010000:0.0:1788390574.014273:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390574.014291:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98e10 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442a1 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.014404:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.014431:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24427e expref: 24 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.014440:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244285 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.014448:0:17210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.014476:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244285 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.014486:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244285 expref: 24 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390574.014496:0:17210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1875263098102528:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390574.014661:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24427e expref: 24 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.014668:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24427e expref: 24 pid: 17210 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390574.014674:0:17210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1875263098102656:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390574.014691:0:17210:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f98868c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390574.017033:0:17210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1875263098102528:192.168.202.11@tcp:104: 00000100:00100000:0.0:1788390574.017050:0:17210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17210:1875263098102656:192.168.202.11@tcp:104: 00010000:00010000:0.0:1788390574.017092:0:17210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390574.017969:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390574.018082:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.018540:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088618624 00000100:00100000:0.0:1788390574.018549:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088618624 00010000:00010000:0.0:1788390574.018587:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244285 expref: 25 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390574.018626:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088618752 00000100:00100000:0.0:1788390574.018630:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088618752 00010000:00010000:0.0:1788390574.018645:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24427e expref: 26 pid: 17210 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390574.018660:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:0.0:1788390574.018670:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+26:2404:x1875263088618624:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390574.018685:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390574.018693:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244285 expref: 26 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018707:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244285 expref: 26 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018732:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98dca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e244285 expref: 26 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018752:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:0.0:1788390574.018757:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018782:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018790:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390574.018854:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+25:2404:x1875263088618624:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 185us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390574.018863:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:0.0:1788390574.018890:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:0.0:1788390574.018908:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984f8604b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+24:2404:x1875263088618752:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390574.018916:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390574.018921:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24427e expref: 24 pid: 17210 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018931:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24427e expref: 24 pid: 17210 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018944:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98db5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e24427e expref: 24 pid: 17210 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018954:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:0.0:1788390574.018958:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018965:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.018973:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.019000:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390574.019020:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984f8604b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+23:2404:x1875263088618752:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 113us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390574.019026:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 18 00010000:00010000:1.0:1788390574.019272:0:17210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.019281:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390574.019299:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788390574.020038:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98e10 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a1 expref: 24 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.020058:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5c00/0xe156d0713be98e17 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a1 expref: 23 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.020066:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:1.0:1788390574.020069:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390574.020081:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b5c00, rc 0) 00000100:00100000:1.0:1788390574.020450:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+23:15667:x1875263088618496:12345-192.168.202.11@tcp:101:dd.0 Request processed in 6202us (6396us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788390574.020459:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 43 00000100:00100000:1.0:1788390574.025885:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390574.026007:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088618880 00000100:00100000:2.0:1788390574.026017:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088618880 00000100:00100000:2.0:1788390574.026127:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 44 00000100:00100000:2.0:1788390574.026139:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+23:15667:x1875263088618880:12345-192.168.202.11@tcp:101:dd.0 00010000:00010000:2.0:1788390574.026163:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390574.026186:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442a8 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.026227:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.026241:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.026253:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.026538:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a8 expref: 25 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.026571:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a8 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.026580:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:2.0:1788390574.026583:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390574.026587:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbf735000, rc 0) 00000100:00100000:2.0:1788390574.026655:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+24:15667:x1875263088618880:12345-192.168.202.11@tcp:101:dd.0 Request processed in 517us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390574.026662:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 44 00000100:00100000:3.0:1788390574.032905:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.033103:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088619136 00000100:00100000:0.0:1788390574.033113:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088619136 00000100:00100000:0.0:1788390574.033229:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:0.0:1788390574.033241:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+24:15667:x1875263088619136:12345-192.168.202.11@tcp:36:dd.0 00010000:00010000:0.0:1788390574.033745:0:19242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.033762:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.033774:0:19242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390574.033820:0:19242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788390574.033847:0:19242:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012f31198 reply state 000000009b2d1b45 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.033860:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.033947:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:0.0:1788390574.033950:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788390574.033954:0:19242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390574.034056:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+27:15667:x1875263088619136:12345-192.168.202.11@tcp:36:dd.0 Request processed in 816us (1166us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788390574.034078:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 45 00000020:00080000:0.0:1788390574.034083:0:19242:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788390574.036700:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.036806:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088619264 00000100:00100000:3.0:1788390574.036816:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088619264 00000100:00100000:3.0:1788390574.036935:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 46 00000100:00100000:3.0:1788390574.036946:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+27:15667:x1875263088619264:12345-192.168.202.11@tcp:101:dd.0 00010000:00010000:3.0:1788390574.036969:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390574.036989:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98e3a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442af expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.037044:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98e3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442af expref: 28 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.037059:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98e3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442af expref: 28 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.037078:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:3.0:1788390574.037092:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390574.037097:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cfe00, rc 0) 00000100:00100000:3.0:1788390574.037157:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+28:15667:x1875263088619264:12345-192.168.202.11@tcp:101:dd.0 Request processed in 212us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.037164:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 46 00000100:00100000:1.0:1788390574.059760:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390574.059889:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088619520 00000100:00100000:2.0:1788390574.059930:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088619520 00000100:00100000:2.0:1788390574.060061:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:2.0:1788390574.060074:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+28:15667:x1875263088619520:12345-192.168.202.11@tcp:103:dd.0 00010000:00010000:2.0:1788390574.060093:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390574.060118:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98e3a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442af expref: 28 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.060140:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:2.0:1788390574.060145:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390574.060206:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+27:15667:x1875263088619520:12345-192.168.202.11@tcp:103:dd.0 Request processed in 135us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390574.060214:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 2 00000100:00100000:1.0:1788390574.064697:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.065592:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088619648 00000100:00100000:0.0:1788390574.065603:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088619648 00000100:00100000:0.0:1788390574.065663:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:0.0:1788390574.065673:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+27:15667:x1875263088619648:12345-192.168.202.11@tcp:58:dd.0 00010000:00010000:0.0:1788390574.065766:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.065782:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.065794:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390574.068018:0:17210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390574.068053:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788390574.068203:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788390574.068307:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+27:15667:x1875263088619648:12345-192.168.202.11@tcp:58:dd.0 Request processed in 2631us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390574.068317:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:1.0:1788390574.073911:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.074359:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088619776 00000100:00100000:3.0:1788390574.074368:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088619776 00000100:00100000:3.0:1788390574.074438:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 48 00000100:00100000:3.0:1788390574.074449:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+27:15667:x1875263088619776:12345-192.168.202.11@tcp:101:dd.0 00010000:00010000:3.0:1788390574.074468:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390574.074488:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98e48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442b6 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.074555:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.074568:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98e48 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442b6 expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.074590:0:17211:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.074603:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98e48 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442b6 expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.074617:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:3.0:1788390574.074620:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390574.074625:0:17211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98e48 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442b6 expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.074651:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf600, rc 0) 00000100:00100000:3.0:1788390574.074715:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+28:15667:x1875263088619776:12345-192.168.202.11@tcp:101:dd.0 Request processed in 268us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.074723:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 48 00000040:00080000:2.0:1788390574.161554:0:17247:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788390574.161564:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390574.161593:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788390574.161616:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788390574.161754:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17247:1875263098102784:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390574.161847:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390574.162342:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390574.162355:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e877cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098102912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788390574.163026:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098103296:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.163085:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098103424:0@lo:400:kworker.0 00000100:00100000:2.0:1788390574.163209:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098103168:0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.174025:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390574.174102:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098103296 00000100:00100000:1.0:1788390574.174110:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098103296 00000100:00100000:1.0:1788390574.174185:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788390574.174198:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098103296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.174253:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098103296:12345-0@lo:400:kworker.0 Request processed in 60us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390574.174261:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788390574.174386:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098103296:0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.174397:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098103808:0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.174425:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390574.174471:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098104320:0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.174498:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390574.174541:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098104320 00000100:00100000:1.0:1788390574.174546:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098104320 00000100:00100000:1.0:1788390574.174576:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788390574.174583:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098104320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.174620:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875263098104320:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390574.174626:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788390574.174656:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1902a00 x1875263098104320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390574.174667:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3625:1875263098104320:0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.174710:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098103808 00000100:00100000:1.0:1788390574.174714:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098103808 00000100:00100000:1.0:1788390574.174742:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390574.174749:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098103808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.174783:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875263098103808:12345-0@lo:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390574.174789:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390574.174817:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3625:1875263098103808:0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.174960:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17247:1875263098102784:192.168.202.11@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1788390574.177154:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788390574.177165:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390574.177227:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390574.177268:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098103936:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177299:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390574.177347:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098103424 00000100:00100000:3.0:1788390574.177354:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098103424 00000100:00100000:3.0:1788390574.177418:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098103936 00000100:00100000:3.0:1788390574.177422:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098103936 00000100:00100000:3.0:1788390574.177445:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390574.177453:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098103424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177503:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875263098103424:12345-0@lo:400:kworker.0 Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.177509:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390574.177524:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788390574.177530:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098103936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177569:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098103936:12345-0@lo:400:kworker.0 Request processed in 40us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.177575:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788390574.177595:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390574.177636:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098103936:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177644:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098104448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177669:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390574.177691:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098104448 00000100:00100000:3.0:1788390574.177694:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098104448 00000100:00100000:3.0:1788390574.177721:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390574.177727:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098104448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177753:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875263098104448:12345-0@lo:400:kworker.0 Request processed in 27us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.177759:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788390574.177772:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390574.177786:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3622:1875263098104448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177810:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788390574.177823:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3622:1875263098103424:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177832:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788390574.177840:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098103040:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177871:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390574.177904:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098103040 00000100:00100000:3.0:1788390574.177907:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098103040 00000100:00100000:3.0:1788390574.177935:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788390574.177943:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3622:x1875263098103040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.177970:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9c7a63f-cc02-4e88-ac45-45156e5cf29e+24:3622:x1875263098103040:12345-0@lo:400:kworker.0 Request processed in 29us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.177976:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788390574.178016:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a9c7a63f-cc02-4e88-ac45-45156e5cf29e:3622:1875263098103040:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.178031:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098103552:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.178057:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390574.178082:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098103552 00000100:00100000:3.0:1788390574.178086:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098103552 00000100:00100000:3.0:1788390574.178115:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390574.178121:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098103552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.178145:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875263098103552:12345-0@lo:400:kworker.0 Request processed in 25us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.178150:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788390574.178170:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875263098103552:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.178176:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098104064:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.178197:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390574.178214:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098104064 00000100:00100000:3.0:1788390574.178217:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098104064 00000100:00100000:3.0:1788390574.178235:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390574.178240:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098104064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.178266:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875263098104064:12345-0@lo:400:kworker.0 Request processed in 25us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.178271:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390574.178296:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875263098104064:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.178302:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098104576:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.178351:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390574.178368:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098104576 00000100:00100000:3.0:1788390574.178371:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098104576 00000100:00100000:3.0:1788390574.178397:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788390574.178409:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098104576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.178438:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875263098104576:12345-0@lo:400:kworker.0 Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.178444:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788390574.178458:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788390574.178476:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff984fc1903b80 x1875263098104576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390574.178486:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3622:1875263098104576:0@lo:400:kworker.0 00000100:00100000:0.0:1788390574.182969:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390574.183156:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098102912 00000100:00100000:3.0:1788390574.183166:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098102912 00000100:00100000:3.0:1788390574.183220:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788390574.183229:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098102912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788390574.183260:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788390574.183344:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098102912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.183352:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390574.183517:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e877cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098102912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788390574.183648:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390574.183684:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098103680:0@lo:400:kworker.0 00000100:00100000:2.0:1788390574.183711:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390574.183726:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098104192:0@lo:400:kworker.0 00000100:00100000:2.0:1788390574.183749:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390574.183764:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098104704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390574.183784:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390574.184120:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390574.184365:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098104192 00000100:00100000:2.0:1788390574.184372:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098104192 00000100:00100000:2.0:1788390574.184428:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088619904 00000100:00100000:2.0:1788390574.184431:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088619904 00000100:00100000:2.0:1788390574.184451:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390574.184459:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098104192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390574.184509:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875263098104192:12345-0@lo:400:kworker.0 Request processed in 51us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390574.184516:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788390574.184532:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 49 00000100:00100000:2.0:1788390574.184653:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+28:15669:x1875263088619904:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788390574.184674:0:19242:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788390574.184773:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+28:15669:x1875263088619904:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 233us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390574.184797:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 49 00000100:00100000:2.0:1788390574.185019:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3624:1875263098104192:0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.185228:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098103168 00000100:00100000:3.0:1788390574.185234:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098103168 00000100:00100000:3.0:1788390574.185271:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098103680 00000100:00100000:3.0:1788390574.185274:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098103680 00000100:00100000:3.0:1788390574.185287:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390574.185293:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098103168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.185365:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098103168:12345-0@lo:400:kworker.0 Request processed in 71us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.185371:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390574.185384:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788390574.185390:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098103680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390574.185428:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875263098103680:12345-0@lo:400:kworker.0 Request processed in 39us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.185435:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788390574.185453:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098104704 00000100:00100000:3.0:1788390574.185456:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098104704 00000100:00100000:3.0:1788390574.185479:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788390574.185486:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098104704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390574.185499:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788390574.185530:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098104704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.185535:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788390574.185555:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390574.185654:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098103168:0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.185667:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3624:1875263098103680:0@lo:400:kworker.0 00000100:00100000:1.0:1788390574.185696:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098104704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390574.193570:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390574.193641:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088620032 00000100:00100000:2.0:1788390574.193652:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088620032 00000100:00100000:2.0:1788390574.193719:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00100000:2.0:1788390574.193729:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+28:15669:x1875263088620032:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788390574.193803:0:19242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.193819:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.193830:0:19242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.193885:0:19242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.193901:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.193908:0:19242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.193931:0:19242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.193939:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.193964:0:19242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390574.194034:0:19242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788390574.194039:0:19242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788390574.194052:0:19242:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194064:0:19242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194070:0:19242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194077:0:19242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194083:0:19242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390574.194088:0:19242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194095:0:19242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194108:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984e86b2af00) 00010000:00010000:2.0:1788390574.194111:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390574.194116:0:19242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194122:0:19242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735200/0xe156d0713be98e4f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194146:0:19242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194153:0:19242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194158:0:19242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194163:0:19242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf734400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390574.194166:0:19242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194172:0:19242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194179:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff984f87f00d00) 00010000:00010000:2.0:1788390574.194182:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390574.194184:0:19242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194190:0:19242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf734400/0xe156d0713be98e56 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194204:0:19242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194211:0:19242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194215:0:19242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194225:0:19242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390574.194228:0:19242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194233:0:19242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194240:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:2.0:1788390574.194242:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390574.194244:0:19242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.194249:0:19242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5800/0xe156d0713be98e5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390574.194377:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+28:15669:x1875263088620032:12345-192.168.202.11@tcp:34:lhsmtool_posix.0 Request processed in 647us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390574.194385:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 50 00000100:00100000:2.0:1788390574.198249:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.200463:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088620288 00000100:00100000:3.0:1788390574.200476:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088620288 00000100:00100000:3.0:1788390574.200584:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:3.0:1788390574.200593:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+28:15669:x1875263088620288:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390574.200611:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390574.200629:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442bd expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200718:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200730:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200739:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390574.200761:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788390574.200825:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200830:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200834:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200838:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390574.200841:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200846:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200854:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:3.0:1788390574.200857:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788390574.200860:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200864:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200918:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e64 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442bd expref: 30 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200929:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984e86b2af00) 00010000:00010000:3.0:1788390574.200931:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390574.200941:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442bd expref: 30 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.200949:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf200, rc 0) 00000100:00100000:3.0:1788390574.201002:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+29:15669:x1875263088620288:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 410us (2762us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788390574.201009:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 51 00000100:00100000:1.0:1788390574.204657:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390574.204762:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088620416 00000100:00100000:2.0:1788390574.204773:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088620416 00000100:00100000:2.0:1788390574.204834:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:2.0:1788390574.204844:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+29:15669:x1875263088620416:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788390574.204906:0:19242:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788390574.205070:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+29:15669:x1875263088620416:12345-192.168.202.11@tcp:53:lhsmtool_posix.0 Request processed in 227us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390574.205079:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 52 00000100:00100000:1.0:1788390574.209644:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.209715:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088620672 00000100:00100000:0.0:1788390574.209726:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088620672 00000100:00100000:0.0:1788390574.209787:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:0.0:1788390574.209798:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+29:15669:x1875263088620672:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390574.209818:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390574.209838:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98e79 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442c4 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390574.210218:0:17211:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:0.0:1788390574.210224:0:17211:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788390574.210242:0:17211:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788390574.210471:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98e80 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.210486:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98e80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.210497:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98e80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.210552:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98e79 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442c4 expref: 32 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.210570:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98e80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442c4 expref: 31 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.210578:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984e86b2a000) 00010000:00010000:1.0:1788390574.210581:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390574.210584:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a81c00, rc 0) 00000100:00100000:1.0:1788390574.210646:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+31:15669:x1875263088620672:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 849us (1010us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788390574.210653:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 53 00000100:00100000:1.0:1788390574.213846:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.213934:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088620928 00000100:00100000:3.0:1788390574.213944:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088620928 00000100:00100000:3.0:1788390574.213997:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 54 00000100:00100000:3.0:1788390574.214005:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+31:15669:x1875263088620928:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390574.214060:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390574.214083:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98e80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442c4 expref: 31 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214098:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984e86b2a000) 00010000:00010000:3.0:1788390574.214108:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390574.214132:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214146:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214157:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214172:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214179:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214199:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214236:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214241:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214246:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214249:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20cf200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390574.214252:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214256:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214261:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:3.0:1788390574.214263:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390574.214265:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214269:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf200/0xe156d0713be98e8e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214276:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214279:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214286:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214290:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fc20ce200 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:3.0:1788390574.214291:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214295:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214299:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7eb7cab0 (ffff984fb7863500) 00010000:00010000:3.0:1788390574.214300:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390574.214301:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.214304:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98e95 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7eb7cab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390574.214417:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+30:15669:x1875263088620928:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 412us (578us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390574.214425:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 54 00000100:00100000:3.0:1788390574.216151:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.216226:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088621056 00000100:00100000:0.0:1788390574.216233:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088621056 00000100:00100000:0.0:1788390574.216277:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 55 00000100:00100000:0.0:1788390574.216286:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+30:15669:x1875263088621056:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390574.216305:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390574.216355:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98e9c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442cb expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.216475:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98ea3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.216505:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.216516:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.216630:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98e9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442cb expref: 32 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.216651:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80600/0xe156d0713be98ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442cb expref: 31 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.216659:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:1.0:1788390574.216662:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788390574.216665:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80600, rc 0) 00000100:00100000:1.0:1788390574.216730:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+31:15669:x1875263088621056:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 445us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390574.216738:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 55 00000100:00100000:1.0:1788390574.219643:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390574.219812:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088621312 00000100:00100000:2.0:1788390574.219837:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088621312 00000100:00100000:2.0:1788390574.220283:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 56 00000100:00100000:2.0:1788390574.220297:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+31:15669:x1875263088621312:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788390574.220430:0:19242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.220448:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.220459:0:19242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390574.220628:0:19242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788390574.220640:0:19242:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394778318005ns, next at 395778314426ns, rc = 0 00000004:00010000:2.0:1788390574.220690:0:19242:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5060beb reply state 00000000ab68160c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.220703:0:19242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.220711:0:19242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:2.0:1788390574.220715:0:19242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788390574.220718:0:19242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788390574.220818:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+33:15669:x1875263088621312:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 524us (1183us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788390574.220826:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 56 00000100:00100000:2.0:1788390574.223255:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390574.223486:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088621440 00000100:00100000:1.0:1788390574.223498:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088621440 00000100:00100000:1.0:1788390574.223561:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 57 00000100:00100000:1.0:1788390574.223572:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+33:15669:x1875263088621440:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390574.223596:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390574.223614:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442d2 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.223688:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d2 expref: 34 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.223703:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d2 expref: 34 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.223721:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:1.0:1788390574.223725:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390574.223729:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984e86a80000, rc 0) 00000100:00100000:1.0:1788390574.223831:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+34:15669:x1875263088621440:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 259us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390574.223840:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 57 00000100:00100000:3.0:1788390574.226814:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390574.229096:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088621568 00000100:00100000:1.0:1788390574.229110:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088621568 00000100:00100000:1.0:1788390574.229272:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00100000:1.0:1788390574.229280:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2404:x1875263088621568:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788390574.229524:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:2404:x1875263088621568:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 242us (2718us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788390574.229532:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 24 00000100:00080000:3.0:1788390574.231861:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390574.232026:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.232206:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088621824 00000100:00100000:0.0:1788390574.232217:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088621824 00000100:00100000:0.0:1788390574.232282:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:0.0:1788390574.232293:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+34:15669:x1875263088621824:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390574.232606:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+35:15669:x1875263088621824:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 314us (584us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788390574.232614:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 9 00000100:00100000:2.0:1788390574.236228:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.236284:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088622080 00000100:00100000:3.0:1788390574.236296:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088622080 00000100:00100000:3.0:1788390574.236386:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 58 00000100:00100000:3.0:1788390574.236397:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+35:15669:x1875263088622080:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390574.236517:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+35:15669:x1875263088622080:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 121us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.236524:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 58 00000100:00100000:1.0:1788390574.238859:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.238954:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088622208 00000100:00100000:3.0:1788390574.238962:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088622208 00000100:00100000:3.0:1788390574.239007:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:3.0:1788390574.239014:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+35:15669:x1875263088622208:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390574.239032:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390574.239049:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98eb8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442d9 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.239141:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98ebf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.239156:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98ebf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.239167:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98ebf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390574.239208:0:17210:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788390574.239224:0:17210:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98ebf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.239245:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98eb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d9 expref: 37 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.239258:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98ebf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d9 expref: 36 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.239273:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:3.0:1788390574.239276:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788390574.239278:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20ce200, rc 0) 00000100:00100000:3.0:1788390574.239371:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+36:15669:x1875263088622208:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 357us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.239378:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 59 00000100:00100000:2.0:1788390574.245498:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.245612:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088622336 00000100:00100000:3.0:1788390574.245623:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088622336 00000100:00100000:3.0:1788390574.245681:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:3.0:1788390574.245689:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fabc2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+6:2405:x1875263088622336:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390574.245706:0:18718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390574.245722:0:18718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442e0 expref: -99 pid: 18718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390574.245743:0:18718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98acae, blocks: 0x0 00010000:00010000:3.0:1788390574.245771:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1788390574.245774:0:18718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390574.245781:0:18718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e0 expref: 7 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.245796:0:18718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e0 expref: 7 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.245807:0:18718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fc20cf200, rc 0) 00000100:00100000:3.0:1788390574.245858:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fabc2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:2405:x1875263088622336:12345-192.168.202.11@tcp:101:lhsmtool_posix.0 Request processed in 169us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.245866:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 25 00000100:00100000:2.0:1788390574.250490:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.250626:0:19242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088622592 00000100:00100000:3.0:1788390574.250637:0:19242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088622592 00000100:00100000:3.0:1788390574.250738:0:19242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:3.0:1788390574.250749:0:19242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+36:15669:x1875263088622592:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788390574.250860:0:19242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+36:15669:x1875263088622592:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 113us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.250868:0:19242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 60 00000100:00100000:0.0:1788390574.255073:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.257109:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088622720 00000100:00100000:3.0:1788390574.257123:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088622720 00000100:00100000:2.0:1788390574.257292:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 61 00000100:00100000:2.0:1788390574.257304:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+36:15669:x1875263088622720:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788390574.259761:0:17189:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788390574.259778:0:17189:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788390574.259832:0:17189:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788390574.259921:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.259934:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.259948:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.259954:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:0.0:1788390574.259959:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.259968:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.259986:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:0.0:1788390574.259989:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788390574.259994:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.260000:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98d53 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390574.260231:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098104832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788390574.260301:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390574.260615:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260624:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260630:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260634:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735400 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390574.260637:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260643:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260652:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984f87f00200) 00010000:00010000:2.0:1788390574.260655:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390574.260658:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260663:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735400/0xe156d0713be98cff lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260680:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260686:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260698:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260703:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbf735e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390574.260706:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260713:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260721:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984f87f00500) 00010000:00010000:2.0:1788390574.260723:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390574.260726:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260732:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735e00/0xe156d0713be98d06 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260745:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260750:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260756:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260761:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5a00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390574.260764:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260780:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260789:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff984fbae70b00) 00010000:00010000:2.0:1788390574.260791:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390574.260794:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260800:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5a00/0xe156d0713be98dae lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260820:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260827:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260833:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260838:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390574.260841:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260847:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260855:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:2.0:1788390574.260857:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390574.260860:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260872:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4c00/0xe156d0713be98e33 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260885:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260902:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260909:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260914:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:2.0:1788390574.260917:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260923:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260931:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:2.0:1788390574.260934:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788390574.260941:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.260947:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98eaa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390574.261071:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+15:15669:x1875263088622720:12345-192.168.202.11@tcp:44:lhsmtool_posix.0 Request processed in 3766us (6006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390574.261080:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 61 00000100:00100000:3.0:1788390574.261940:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098104832 00000100:00100000:3.0:1788390574.261951:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098104832 00000100:00100000:2.0:1788390574.262133:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788390574.262143:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875263098104832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788390574.262278:0:19543:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788390574.262282:0:19543:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788390574.262285:0:19543:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788390574.262287:0:19543:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788390574 -> 1788390574 00002000:00010000:2.0:1788390574.262289:0:19543:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788390574.262378:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1875263098104832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (2077us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788390574.262386:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1788390574.262547:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984e87b2f480/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788390574.262555:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3625:1875263098104832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788390574.265380:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.265459:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088622848 00000100:00100000:3.0:1788390574.265469:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088622848 00000100:00100000:3.0:1788390574.265523:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 27 00000100:00100000:3.0:1788390574.265534:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:2404:x1875263088622848:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788390574.265650:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:2404:x1875263088622848:12345-192.168.202.11@tcp:16:lhsmtool_posix.0 Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.265658:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 27 00000100:00100000:0.0:1788390574.270135:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.270273:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088623104 00000100:00100000:3.0:1788390574.270284:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088623104 00000100:00100000:3.0:1788390574.270383:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 62 00000100:00100000:3.0:1788390574.270406:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+15:15669:x1875263088623104:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390574.270461:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390574.270501:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20ce200/0xe156d0713be98ebf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d9 expref: 15 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.270522:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:3.0:1788390574.270527:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390574.270572:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98ecd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.270587:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98ecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.270596:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98ecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390574.270716:0:17209:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1270233 reply state 0000000003a3c297 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98ecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.270728:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cfe00/0xe156d0713be98ecd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.270734:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:3.0:1788390574.270737:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788390574.270739:0:17209:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390574.270834:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+16:15669:x1875263088623104:12345-192.168.202.11@tcp:36:lhsmtool_posix.0 Request processed in 432us (711us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788390574.270842:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 62 00000100:00100000:0.0:1788390574.275097:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.275282:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088623232 00000100:00100000:3.0:1788390574.275293:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088623232 00000100:00100000:3.0:1788390574.275384:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:3.0:1788390574.275408:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:2405:x1875263088623232:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788390574.275575:0:18716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788390574.275579:0:18716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788390573 00002000:00010000:3.0:1788390574.275581:0:18716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788390573 00002000:00010000:3.0:1788390574.275583:0:18716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788390574 -> 1788390573 00002000:00010000:3.0:1788390574.275586:0:18716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788390574.275645:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+8:2405:x1875263088623232:12345-192.168.202.11@tcp:2:lhsmtool_posix.0 Request processed in 251us (556us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788390574.275653:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 28 00000100:00100000:1.0:1788390574.280515:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390574.280636:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088623360 00000100:00100000:2.0:1788390574.280647:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088623360 00000100:00100000:2.0:1788390574.280710:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00100000:2.0:1788390574.280720:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+8:2406:x1875263088623360:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788390574.280762:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.280779:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390574.280783:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390574.280789:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.280803:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.280828:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.280850:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.280858:0:18717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.280866:0:18717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5e00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:2.0:1788390574.280878:0:18717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.280887:0:18717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.280922:0:18717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.280931:0:18717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d458375/0xe156d0713be98ed4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390574.281065:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+8:2406:x1875263088623360:12345-192.168.202.11@tcp:1:lhsmtool_posix.0 Request processed in 345us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390574.281073:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 29 00000100:00100000:0.0:1788390574.290910:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:3.0:1788390574.294722:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088623616 00000100:00100000:3.0:1788390574.294737:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088623616 00000100:00100000:2.0:1788390574.294957:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 63 00000100:00100000:2.0:1788390574.294969:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+16:15669:x1875263088623616:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788390574.295095:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.295114:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a8 expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.295125:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.295166:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a8 expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.295182:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a8 expref: 16 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390574.295196:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1875263098104960:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390574.295293:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390574.298937:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1875263098104960:192.168.202.11@tcp:104: 00010000:00010000:2.0:1788390574.298967:0:17211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390574.302695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.302811:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088623744 00000100:00100000:0.0:1788390574.302821:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088623744 00010000:00010000:0.0:1788390574.302864:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a8 expref: 17 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390574.302933:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:0.0:1788390574.302959:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+17:2404:x1875263088623744:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390574.302975:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390574.302984:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a8 expref: 17 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.302999:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a8 expref: 17 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.303023:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbf735000/0xe156d0713be98e2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442a8 expref: 17 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.303042:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:0.0:1788390574.303048:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98e48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442b6 expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.303071:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.303080:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.303087:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.303170:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390574.303227:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+16:2404:x1875263088623744:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 270us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390574.303235:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 19 00010000:00010000:2.0:1788390574.303684:0:17211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.303693:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.304715:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.304742:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d2 expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.304751:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.304788:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d2 expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.304804:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d2 expref: 16 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390574.304819:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1875263098105088:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390574.305028:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390574.310484:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390574.310614:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1875263098105088:192.168.202.11@tcp:104: 00000100:00100000:3.0:1788390574.310617:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088623872 00000100:00100000:3.0:1788390574.310624:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088623872 00010000:00010000:1.0:1788390574.310651:0:17211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.310659:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d2 expref: 17 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390574.310697:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 20 00000100:00100000:3.0:1788390574.310707:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+17:2404:x1875263088623872:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390574.310721:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390574.310728:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d2 expref: 17 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.310740:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d2 expref: 17 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.310757:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a80000/0xe156d0713be98eb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442d2 expref: 17 pid: 17211 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.310777:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:3.0:1788390574.310780:0:17196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.310787:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.310792:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390574.310810:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390574.310834:0:17211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.310841:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390574.310865:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+16:2404:x1875263088623872:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 160us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.310873:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 20 00000001:00080000:1.0:1788390574.311561:0:17211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788390574.311683:0:17211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788390574.311719:0:17211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788390574.311803:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17211:1875263098105216:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788390574.311859:0:17211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390574.311915:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f91526840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390574.311930:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098105216 00000100:00100000:3.0:1788390574.311936:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098105216 00000100:00100000:3.0:1788390574.311991:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788390574.312001:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17211:x1875263098105216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788390574.312082:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17211:x1875263098105216:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390574.312089:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788390574.312179:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17211:1875263098105216:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788390574.312342:0:17211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788390574.312383:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17211:1875263098105344:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788390574.312412:0:17211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390574.312436:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83071480 going to sleep for 11 seconds 00000100:00100000:2.0:1788390574.312488:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098105344 00000100:00100000:2.0:1788390574.312493:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098105344 00000100:00100000:2.0:1788390574.312570:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788390574.312579:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17211:x1875263098105344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788390574.312689:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17211:x1875263098105344:12345-0@lo:1000:mdt00_002.0 Request processed in 112us (275us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788390574.312696:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788390574.312752:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17211:1875263098105344:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788390574.312780:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312789:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312796:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312818:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390574.312823:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312831:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312846:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:1.0:1788390574.312849:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390574.312854:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312860:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d5e00/0xe156d0713be98ee2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312913:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312920:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312926:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312931:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4e00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390574.312934:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312941:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312963:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:1.0:1788390574.312966:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390574.312973:0:17211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98e48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442b6 expref: 19 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312984:0:17211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98e48 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442b6 expref: 19 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.312994:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98e48 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442b6 expref: 19 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.313045:0:17211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff984fc20cf600/0xe156d0713be98e48 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442b6 expref: 19 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390574.313071:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1875263098105472:192.168.202.11@tcp:105: 00000100:00100000:1.0:1788390574.313141:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff984fbb249c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390574.315481:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1901180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17211:1875263098105472:192.168.202.11@tcp:105: 00010000:00010000:1.0:1788390574.315510:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315520:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4e00/0xe156d0713be98e41 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315555:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315568:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315592:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315602:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315608:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315614:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315620:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984e86a81c00 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390574.315624:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315632:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315643:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:1.0:1788390574.315646:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390574.315649:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315655:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984e86a81c00/0xe156d0713be98ee9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315664:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315670:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315683:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315688:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d4800 already unused, calling callback (ffffffffc19ce4f0) 00010000:00010000:1.0:1788390574.315691:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315698:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315707:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:1.0:1788390574.315710:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788390574.315713:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.315718:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984f846d4800/0xe156d0713be98edb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390574.315904:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+19:15669:x1875263088623616:12345-192.168.202.11@tcp:57:lhsmtool_posix.0 Request processed in 20926us (24991us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788390574.315913:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 63 00000020:00080000:1.0:1788390574.315919:0:17211:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788390574.316009:0:17247:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788390574.316014:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390574.316030:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788390574.316036:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788390574.317100:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.317180:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088624000 00000100:00100000:0.0:1788390574.317201:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088624000 00000100:00100000:0.0:1788390574.317255:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:0.0:1788390574.317265:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87939c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+19:15667:x1875263088624000:12345-192.168.202.11@tcp:49:dd.0 00000100:00100000:0.0:1788390574.317406:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87939c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+19:15667:x1875263088624000:12345-192.168.202.11@tcp:49:dd.0 Request processed in 142us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390574.317414:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 10 00000100:00100000:2.0:1788390574.318790:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.318845:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088624256 00000100:00100000:0.0:1788390574.318853:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088624256 00000100:00100000:0.0:1788390574.318905:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 11 00000100:00100000:0.0:1788390574.318915:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e868c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+19:15669:x1875263088624256:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788390574.319165:0:17213:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788390574.319198:0:17213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788390574.319232:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.319249:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.319261:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.319268:0:17213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.319274:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.319280:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.319318:0:17213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788390574.319420:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e868c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+21:15669:x1875263088624256:12345-192.168.202.11@tcp:35:lhsmtool_posix.0 Request processed in 505us (634us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788390574.319427:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 11 00000020:00080000:0.0:1788390574.319432:0:17213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788390574.319726:0:17198:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390574.319733:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.319740:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b5800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390574.319744:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.319761:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.319774:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984fbae70200) 00010000:00010000:1.0:1788390574.319777:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788390574.319781:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.319787:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5800/0xe156d0713be98ef0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.319800:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390574.319801:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390574.319803:0:17198:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390574.320818:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.320921:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088624384 00000100:00100000:0.0:1788390574.320930:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088624384 00000100:00100000:0.0:1788390574.320984:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 64 00000100:00100000:0.0:1788390574.320994:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+21:15667:x1875263088624384:12345-192.168.202.11@tcp:101:dd.0 00010000:00010000:0.0:1788390574.321011:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390574.321027:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98ef7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde418a6f9e2442e7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.321058:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98efe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.321069:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98efe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.321080:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98efe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.321181:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b5200/0xe156d0713be98ef7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e7 expref: 23 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.321199:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984fbb3b4a00/0xe156d0713be98efe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e7 expref: 22 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.321218:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984fbae70300) 00010000:00010000:0.0:1788390574.321221:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390574.321224:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984fbb3b4a00, rc 0) 00000100:00100000:0.0:1788390574.321275:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+22:15667:x1875263088624384:12345-192.168.202.11@tcp:101:dd.0 Request processed in 282us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390574.321282:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 64 00000100:00100000:3.0:1788390574.494185:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:2.0:1788390574.494837:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088624512 00000100:00100000:2.0:1788390574.494849:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088624512 00000100:00100000:2.0:1788390574.494947:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:2.0:1788390574.494959:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+8:2407:x1875263088624512:12345-192.168.202.11@tcp:4:dd.0 00010000:00010000:2.0:1788390574.495002:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.495026:0:18721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e0 expref: 8 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.495036:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788390574.495041:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390574.495058:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.495096:0:18721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e0 expref: 8 pid: 18718 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.495111:0:18721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e0 expref: 8 pid: 18718 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390574.495127:0:18721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e868c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18721:1875263098105600:192.168.202.11@tcp:104: 00000100:00100000:2.0:1788390574.495225:0:18721:0:(client.c:2715:ptlrpc_set_wait()) set ffff984f83ee5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390574.497499:0:18721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e868c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18721:1875263098105600:192.168.202.11@tcp:104: 00010000:00010000:3.0:1788390574.497532:0:18721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390574.500062:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.500179:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088624768 00000100:00100000:0.0:1788390574.500189:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088624768 00010000:00010000:0.0:1788390574.500224:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e0 expref: 9 pid: 18718 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390574.500270:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 21 00000100:00100000:0.0:1788390574.500279:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:2404:x1875263088624768:12345-192.168.202.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390574.500295:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390574.500317:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e0 expref: 9 pid: 18718 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.500362:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e0 expref: 9 pid: 18718 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.500393:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f20849c/0xe156d0713be98ec6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.11@tcp remote: 0xde418a6f9e2442e0 expref: 9 pid: 18718 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.500412:0:17194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390574.500430:0:17194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390574.500436:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.500446:0:17194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.500485:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390574.500708:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+8:2404:x1875263088624768:12345-192.168.202.11@tcp:103:ldlm_bl.0 Request processed in 428us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390574.500717:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 21 00010000:00010000:2.0:1788390574.501765:0:18721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390574.501781:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390574.511244:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:0.0:1788390574.511489:0:18723:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788390574.511498:0:18723:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788390574.511656:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088624640 00000100:00100000:0.0:1788390574.511666:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088624640 00000100:00100000:0.0:1788390574.512542:0:20347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 1 00000100:00100000:0.0:1788390574.512555:0:20347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+9:2407:x1875263088624640:12345-192.168.202.11@tcp:4:dd.0 00010000:00010000:0.0:1788390574.512596:0:20347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.512616:0:20347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390574.512620:0:20347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390574.512626:0:20347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.512642:0:20347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788390574.568986:0:19529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1788390574.569011:0:19529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788390574.576071:0:20347:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1788390574.576081:0:20347:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788390573 -> 1788390574 00002000:00010000:1.0:1788390574.576084:0:20347:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788390573 -> 1788390574 00002000:00010000:1.0:1788390574.576087:0:20347:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1788390574.576105:0:20347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.576119:0:20347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.576128:0:20347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.576151:0:20347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984fbb3b4c00 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:1.0:1788390574.576157:0:20347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.576166:0:20347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.576186:0:20347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390574.576194:0:20347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc46da14/0xe156d0713be98f0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390574.576659:0:20347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+7:2407:x1875263088624640:12345-192.168.202.11@tcp:4:dd.0 Request processed in 64100us (65417us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788390574.576686:0:20347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 1 00000001:00080000:1.0:1788390574.585994:0:19529:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1788390574.587072:0:18721:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1788390574.587096:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.587110:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.587119:0:18721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.587126:0:18721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984f846d5800 already unused, calling callback (ffffffffc0dd6230) 00010000:00010000:0.0:1788390574.587131:0:18721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.587141:0:18721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.587160:0:18721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390574.587168:0:18721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ec2a9be/0xe156d0713be98f05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390574.587369:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2407:x1875263088624512:12345-192.168.202.11@tcp:4:dd.0 Request processed in 92360us (93142us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788390574.587381:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 0 00000100:00100000:0.0:1788390574.673855:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390574.673877:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098105728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788390574.673955:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390574.676022:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098105728 00000100:00100000:1.0:1788390574.676039:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098105728 00000100:00100000:1.0:1788390574.676109:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788390574.676120:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e877c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098105728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788390574.676157:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788390574.676238:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e877c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875263098105728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390574.676245:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390574.676388:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3623:1875263098105728:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788390574.993940:0:17964:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390575.185498:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390575.185522:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984e87b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098105856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788390575.185595:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390575.185637:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098105856 00000100:00100000:3.0:1788390575.185647:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098105856 00000100:00100000:3.0:1788390575.185696:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788390575.185708:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984e87b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098105856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788390575.185738:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788390575.185779:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984e87b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875263098105856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390575.185786:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788390575.185845:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984e87b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3622:1875263098105856:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1788390575.637264:0:20384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788390576.017972:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390576.210087:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fc1900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098105984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390576.210152:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390576.210200:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098105984 00000100:00100000:1.0:1788390576.210207:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098105984 00000100:00100000:1.0:1788390576.210254:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390576.210263:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098105984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390576.210283:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788390576.210318:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098105984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.210347:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390576.210387:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fc1900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098105984:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390576.210417:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390576.416122:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390576.416191:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088624896 00000100:00100000:1.0:1788390576.416200:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088624896 00000100:00100000:1.0:1788390576.416246:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 160 00000100:00100000:1.0:1788390576.416253:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+13:2407:x1875263088624896:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390576.416313:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb1e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fb022f-9af8-4a30-a638-8170d305c354+13:2407:x1875263088624896:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 61us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.416335:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 160 00000100:00100000:1.0:1788390576.416650:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390576.416671:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390576.416685:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390576.416696:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390576.416708:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390576.416722:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088625024 00000100:00100000:1.0:1788390576.416731:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088625024 00000100:00100000:1.0:1788390576.416757:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088625152 00000100:00100000:1.0:1788390576.416759:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088625152 00000100:00100000:1.0:1788390576.416766:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088625536 00000100:00100000:1.0:1788390576.416767:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088625536 00000100:00100000:1.0:1788390576.416776:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:1.0:1788390576.416780:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+22:2407:x1875263088625024:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390576.416810:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+22:2407:x1875263088625024:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 29us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.416814:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 45 00000100:00100000:1.0:1788390576.416822:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 46 00000100:00100000:1.0:1788390576.416825:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2407:x1875263088625152:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390576.416838:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2407:x1875263088625152:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 13us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.416843:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 46 00000100:00100000:1.0:1788390576.416853:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:1.0:1788390576.416858:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+6:2407:x1875263088625536:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390576.416893:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+6:2407:x1875263088625536:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.416899:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 47 00000100:00100000:1.0:1788390576.416916:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088625280 00000100:00100000:1.0:1788390576.416920:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088625280 00000100:00100000:1.0:1788390576.416939:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088625408 00000100:00100000:1.0:1788390576.416942:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088625408 00000100:00100000:1.0:1788390576.416960:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:1.0:1788390576.416966:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2407:x1875263088625280:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390576.416999:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2407:x1875263088625280:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.417004:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 16 00000100:00100000:1.0:1788390576.417012:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00100000:1.0:1788390576.417016:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fc1903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2407:x1875263088625408:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390576.417029:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fc1903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:329324d4-66cc-4fcf-a4fb-c56e5dbdbd79+5:2407:x1875263088625408:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 14us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.417033:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 17 00000100:00080000:1.0:1788390576.417047:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390576.417050:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390576.417051:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788390576.417053:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390576.424367:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390576.424403:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390576.424485:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.11@tcp (source: 12345-192.168.202.11@tcp) 00000100:00100000:1.0:1788390576.424521:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088625792 00000100:00100000:1.0:1788390576.424531:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088625792 00000100:00100000:1.0:1788390576.424587:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088625920 00000100:00100000:1.0:1788390576.424590:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088625920 00000100:00100000:1.0:1788390576.424613:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:1.0:1788390576.424622:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f61dd075-8549-4456-90c9-4c71677dd147+5:2407:x1875263088625792:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390576.424693:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f61dd075-8549-4456-90c9-4c71677dd147+5:2407:x1875263088625792:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 72us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.424701:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 18 00000100:00100000:1.0:1788390576.424718:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00100000:1.0:1788390576.424724:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f61dd075-8549-4456-90c9-4c71677dd147+5:2407:x1875263088625920:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390576.424764:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f61dd075-8549-4456-90c9-4c71677dd147+5:2407:x1875263088625920:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 39us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.424770:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 19 00000100:00080000:1.0:1788390576.424793:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788390576.424797:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390576.424900:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263088625664 00000100:00100000:1.0:1788390576.424904:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263088625664 00000100:00100000:1.0:1788390576.424935:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.11@tcp, seq: 48 00000100:00100000:1.0:1788390576.424942:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+5:2406:x1875263088625664:12345-192.168.202.11@tcp:400:kworker.0 00000100:00100000:1.0:1788390576.424974:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f61dd075-8549-4456-90c9-4c71677dd147+5:2406:x1875263088625664:12345-192.168.202.11@tcp:400:kworker.0 Request processed in 32us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390576.424980:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.11@tcp, seq: 48 00000100:00080000:1.0:1788390576.424997:0:17205:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788390576.722709:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390576.722736:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984fbb2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098106112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788390576.722808:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390576.722906:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263098106112 00000100:00100000:2.0:1788390576.722914:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263098106112 00000100:00100000:2.0:1788390576.722966:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788390576.722979:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984fbb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098106112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788390576.723016:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788390576.723060:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984fbb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875263098106112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390576.723068:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788390576.723156:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984fbb2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3624:1875263098106112:0@lo:41:osp-pre-1-0.0 Debug log: 38789 lines, 38789 kept, 0 dropped, 0 bad.